LLMs are useful tools, but if they don't lead to something you can actually somewhat rely on to generate correct/consistent/factual results (see e.g. the recent Air Canada chatbot lawsuit) then the hype is a bust. TBD.
The bar I'm setting is far from "impossible"; even human children generally won't seamlessly confabulate when you ask them a question they don't know the answer to. Again citing the recent Air Canada case, these models can't even reliably answer simple questions that are definitively and objectively answered in documentation that is presumably made as freely available to them as is technically possible under the limitations of current technology.
No well-informed sources are saying that. If you're saying that mainstream reporting and other non-tech folks are wrong about what the possibilities are then... obviously.
Yes they are, actually! I've talked to people who obsessively read practically every LLM paper that passes through the arxiv, with undeniably deep and broad knowledge of the current state of this tech, who seriously believe it's going to surpass humans within a year or two. That it may already have, in the deep dark top secret labs beneath OpenAI HQ.
However,
> If you're saying that mainstream reporting and other non-tech folks are wrong about what the possibilities are then... obviously.
If it was obvious then why are you still replying to my comments, which have very obviously been specifically addressing the mismatch between hype and reality? If the current approach doesn't scale, the hype will have been a bust! Objectively! That's what I've been talking about this whole time!
"Mainstream reporting and other non-tech folks" is a bit disingenuous, though. The primary drivers of the current unrealistic hype are software vendors and associated clingers-on looking to make a quick buck. They'll say anything, regardless of whether it's true, and as a result of those mostly-falsehoods our public lives will be flooded with awful AI tools that make everything shittier and more difficult. I can't wait!
I literally have a 24/7 consultant with surface level understand of any topic in human history. This consultant also happens to be an amazing artist for $25 a month that gives me the rights to commercialize any art piece they make for me.
This is extremely hard to beat. This will be extremely hard to beat.
As a business they are succeeding.