News for hackers. Stuff that matters.
Re:The Collapse of GPT by gerdesj on Friday May 16, 2025 @08:39PM (#44011103)
You seem to be arguing that bollocks couched in flowery language is a stretch goal of AI.

Are you sure?

Re:The Collapse of GPT by _heimdall on Friday May 16, 2025 @08:51PM (#44011170)
That really depends on expectations.

If AI is meant to sound nearly identical to a human, you don't need more training data.

If its meant to act as a natural language encyclopedia, we'll never get there with LLMs which amount to natural language processing on top of a massively compressed dataset.

Re:The Collapse of GPT by gerdesj on Friday May 16, 2025 @09:13PM (#44011269)
I've read the Google page "Getting AI to write good SQL: Text-to-SQL techniques explained" and it looks like all the usual bollocks.

... and sigh ... it look like I'm twiddling with a noddy!

Re:The Collapse of GPT by mondrian on Sunday May 18, 2025 @04:21AM (#44019834)
Trying to make AIs more factually-accurate with more training is probably hopeless. Current events and encyclopedic knowledge will be provided by tools. The LLM's core job is to choose the right tools for the job and synthesize their outputs.