News for hackers. Stuff that matters.
Re:Are we racing toward AI catastrophe? by unxdfa on Monday February 13, 2023 @06:35AM (#34772344)
This is the future I predicted years ago. I’m betting on selling myself as AI-clean because I know there is a market of people who understand the commercial, legal and societal risks associated with it. This is Pandora’s box and I don’t want to be near it.

Verified, carefully reviewed and well sourced information and data still has a place and will have a much higher value than it does now when the signal to noise ratio decreases.

Re:Are we racing toward AI catastrophe? by ianai on Monday February 13, 2023 @06:54AM (#34772462)
Might be quite the wait for the Butlerian Jihad.
Re:Are we racing toward AI catastrophe? by qbrass on Monday February 13, 2023 @07:38AM (#34772735)
11,000 years or so, canonically.
Re:Are we racing toward AI catastrophe? by unxdfa on Monday February 13, 2023 @08:53AM (#34773356)
That did come to mind :)
Re:Are we racing toward AI catastrophe? by valine on Monday February 13, 2023 @07:14AM (#34772601)
The thing is LLMs can be tested and inaccuracies corrected. In a year when the ChatGPTs of the world have API access to augment their already impressive capabilities, I doubt there will be many complaints about accuracy.

You can’t run benchmarks on an AI-clean meat sack.

Re:Are we racing toward AI catastrophe? by unxdfa on Monday February 13, 2023 @08:56AM (#34773383)
Wait until people start training AI on AI output because (a) that's the only source of information left with a large enough corpus size and (b) all other sources are polluted.

There's no way of asserting accuracy when we reach that point because the very nature of information and scientific thinking will be corrupted.

Re:Are we racing toward AI catastrophe? by valine on Monday February 13, 2023 @09:52AM (#34774091)
There is evidence to suggest that LLMs have recently passed a threshold where their performance can be improved by training on their own output.

https://arxiv.org/abs/2210.11610

I expect your concerns are likely unwarranted.

Re:Are we racing toward AI catastrophe? by danaris on Monday February 13, 2023 @03:32PM (#34779965)
How does this do anything but validate their concerns?

They're not saying "if we train LLMs on their own output, they'll get slower or worse", they're saying "if we train LLMs on their own output, it gets even harder to actually derive sourcing for what they produce."

Re:Are we racing toward AI catastrophe? by pegasus on Monday February 13, 2023 @01:35PM (#34777996)
That's what proponents of self-driving cars keep promising also.
Re:Are we racing toward AI catastrophe? by unxdfa on Tuesday February 14, 2023 @03:12PM (#34795299)
Self crashing cars please.