{"id":5422,"date":"2025-12-08T21:47:47","date_gmt":"2025-12-09T02:47:47","guid":{"rendered":"https:\/\/ikriv.com\/blog\/?p=5422"},"modified":"2025-12-08T21:47:47","modified_gmt":"2025-12-09T02:47:47","slug":"example-of-llm-confusion-over-a-word-with-multiple-meanings","status":"publish","type":"post","link":"https:\/\/ikriv.com\/blog\/?p=5422","title":{"rendered":"Example of LLM confusion over a word with multiple meanings"},"content":{"rendered":"<p>In our system we can &#8220;hide&#8221; a user conversation in two ways.<\/p>\n<ul>\n<li>There are internal &#8220;service&#8221; conversations that are technically owned by a user, but are not supposed to be visible on the main screen. E.g. automatically scheduled jobs. They still can be examined in more detailed screens.<\/li>\n<li>There is a security system where user A can make a conversation &#8220;public&#8221; (visible for all) or &#8220;hide&#8221; it, i.e. make it visible only for that user.<\/li>\n<\/ul>\n<p>Even though in both cases we can talk about &#8220;hiding&#8221; a conversation, these are two completely different things and humans never confuse these.<br \/>\nThe LLM, however, was not as smart: I was talking to <code>claude-4.5-opus-high<\/code> about service conversation for some time, but when I asked how can I create a hidden conversation in the UI, it referred me to the button that operates on the security setting, because it happens to use the word &#8220;hide&#8221;. Rather disappointing.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In our system we can &#8220;hide&#8221; a user conversation in two ways. There are internal &#8220;service&#8221; conversations that are technically owned by a user, but are not supposed to be <a href=\"https:\/\/ikriv.com\/blog\/?p=5422\" class=\"more-link\">[&hellip;]<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"Layout":"","footnotes":""},"categories":[32],"tags":[],"class_list":["entry","author-ikriv","post-5422","post","type-post","status-publish","format-standard","category-ai"],"_links":{"self":[{"href":"https:\/\/ikriv.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/5422","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ikriv.com\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ikriv.com\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ikriv.com\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ikriv.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5422"}],"version-history":[{"count":1,"href":"https:\/\/ikriv.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/5422\/revisions"}],"predecessor-version":[{"id":5423,"href":"https:\/\/ikriv.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/5422\/revisions\/5423"}],"wp:attachment":[{"href":"https:\/\/ikriv.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5422"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ikriv.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5422"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ikriv.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5422"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}