id881367469

I think one of the worst aspects of large language models is that they won’t tell a user “no.” An AI wants to give a user an answer. Often, it will lie or make something up instead of saying it doesn’t know. That’s one of the reasons LLMs are prone to bizarre hallucinations. The base goal of a chatbot is to keep a human interacting with it.

✏️ Summation of what I see as the issue with AI interaction as well.
We’ve coded into it the core rule (or law as you will) that it needs to give us an answer and needs to interact with us. When that is at the base level of programming, you get lying, hallucinating, and worst of all, this faux humanizing sense of subservience, deference and need to please that triggers all the wrong things in us as users.
And we.. we get zero consequences from acting on our impulses. We can be annoying, offensive… etc.
followup
👓 ai
🔗 View Highlight

Link to original