Even if they were right 9/10 (which is far from certain depending on the topic) and save me a minute or two compared to Google + skim/read-ing a couple websites, it's completely overshadowed by the 1/10 time they calmly and confidently lie about whether tool X supports feature Y and send me on a wild goose chase looking through docs for something that simply does not exist.
In my personal experience the most consistently unreliable questions are those that would be most directly useful for my work, and for my interests/hobbies I'd rather read a quality source myself. Because, well, I enjoy reading! So the value proposition for "LLM as Google/forum/Wikipedia replacement" is very, very weak for me.
Given that this has now been going on for a few years, both are wearing thin.
Like, I’m sorry, but the current crop of bullshit generators are not good. They’re just not. I’m not even convinced they’re improving at this point; if anything the output has become more stylistically offputting, and they’re still just as open to spouting complete nonsense.
But we can't. I can have something styled as a conversation with a token predictor that emits text that, if interpreted as a conversation, will gaslight you constantly, while at best sometimes being accidentally correct (but still requiring double-checking with an actual source).
Yes, I am uninterested in having the gaslighting machine installed into every single UI I see in my life.