Verified, carefully reviewed and well sourced information and data still has a place and will have a much higher value than it does now when the signal to noise ratio decreases.
You can’t run benchmarks on an AI-clean meat sack.
There's no way of asserting accuracy when we reach that point because the very nature of information and scientific thinking will be corrupted.
https://arxiv.org/abs/2210.11610
I expect your concerns are likely unwarranted.
They're not saying "if we train LLMs on their own output, they'll get slower or worse", they're saying "if we train LLMs on their own output, it gets even harder to actually derive sourcing for what they produce."
You already cannot trust anything, because it's being generated with humans with political agendas.
> An AI without conciousness, without goals
Better without goals than with goals that threaten the people.
The only thing that will rise is the level of noise compared to usable data... and with seo-optimized articles, there has been a lot of noise already.
"Who would go on the internet and tell lies??"
An AI without goals is functionally equal to an AI with nefarious or unethical goals - boundless action trained on human language / behavior will likely skew bad.
"we will only see the damage long-term" -- I'm not confident this is true or false. I can see a few things ahead of us though!
Here's my predictions:
1. The most profitable AI will be a webapp version of a hostess club that aggrandizes, validates and flatters for cash. At some point it'll get too good at this and humans will have to step in to moderate it so it bankrupts fewer people. It'll get warning labels.
Within this model will be really sinister truths about the human condition that will be hard to prize out.
2. In the short term, there will be a few really wonderful works of art created that will benefit from the force multiplication AI tools provide.
This is not going to happen, isn't it? Even if riddled with chatbots is still persuasive enough to generate engagement. Some could choose dark corners, but for the majority would be business as usual.
Speaking of business as usual, how the fuck the ad business could survive this? The only way out that I can see is it if IDs are forced on us somehow, but that's a shitshow in itself.
So like the world was about 20 years ago?
we're approaching Brazil.
I see some hope though. In-person communication becomes more valuable again. Established media with editorial review and reporters on the scene becomes valuable again. Software freedom gets a boost with more intelligent reverse engineering/translation.
Sites like YouTube also won't sit idly by while untold millions of AI generated garbage videos are uploaded and not viewed.
Imagine even more power concentration in the hands of those with the required hardware to use AI. Imagine you can no longer trust any information, because the internet is being swamped by generated half-truths. An AI without conciousness, without goals, just a mastery of the language game and a poor world model. Really useful to make knowledge workers superfluous, and such that we will only see the damage long-term. And imagine all the polarisation and hysteria of social media, but x10 because the AI can close the feedback loop much faster.
If this happens we can't blame the technology, it will be entirely self-inflicted.