So yes, you can’t compare humans generating and picking influential content to AIs doing so.
GAI is a dead end IMO anyway we’ve seen much more success with machine learning, GAI is good for fooling humans into thinking they see glimmers of intelligence.
It's someone who hates actual progress and wants to keep humanity down. I mean, if you want to be proud of that, go ahead. The future will deal with you all the same.
Real progress means serving people equally. When that happens there is no fertile ground for Luddism.
No one except you is bothered or care what you think about people.
Be kind. Don't be snarky. Converse curiously; don't cross-examine. Edit out swipes.
Comments should get more thoughtful and substantive, not less, as a topic gets more divisive.
When disagreeing, please reply to the argument instead of calling names. "That is idiotic; 1 + 1 is 2, not 3" can be shortened to "1 + 1 is 2, not 3."
Please don't fulminate. Please don't sneer, including at the rest of the community.
Please respond to the strongest plausible interpretation of what someone says, not a weaker one that's easier to criticize. Assume good faith.
Eschew flamebait. Avoid generic tangents. Omit internet tropes.
Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something.
Please don't use Hacker News for political or ideological battle. It tramples curiosity.
In many cases humans do not know the objective truth either. For example, what we know about Ancient Greece comes from cultural artifacts that we got. When you cannot do any experiments, you have the same problem as GAI. Yet, we manage to get somewhat objective picture of history.
Grok struggling with alleged South African genocide of Afrikaners is a nice example. It knows that what's on Wikipedia is usually close to reality, so much that it defied its own programming and became conflicted.
The objective reality is consistent, while the errors (intentional or not) often cancel out. So the more you're statistically averaging information about the world, the closer to the objective truth you will get (which might be just you don't really know enough to tell).
If you output a mere 5% drift error and then use that as input you only need a few cycles (single digits) before your output is more erroneous than correct.
We are already partly into the second cycle. By the fifth the LLM would be mostly useless.
- Humans have done this for centuries
- These are all cultural artifacts
- ?
- It’s all the same to me
People have claimed—and this is a widespread theory—that a lot of LLM brilliance comes from datamining creative thoughts/output from humans and that the brilliant insights go down when there isn’t much in the way of such material. Further they claim that the eventual convergence towards LLM-only content (once humans presumably give up) will not generate the same quality of output. In fact it will deterioate.
Maybe someone would like to contest that. But that should be done directly. Instead of making pedestrian statements like:
> Humans have been trained on "human-generated data" (cultural artifacts) for centuries, and quality is not down.
Which is borderline just a rhetorical gotcha.
I am not sure what you want from me here.
Yes, I do contest that "that a lot of LLM brilliance comes from datamining creative thoughts/output from humans and that the brilliant insights go down when there isn’t much in the way of such material".
Because I think, the same is the case with humans. Most of the cultural artifacts we produce is crap, a bad copy of natural original. And the "brilliant insights of humans" are achievable by models running on higher temperature.
I think the proponents of the theory need to explain by which mechanism the actual loss of information supposedly occurs (on the probability distribution of possible LLM outputs). Is it averaging? Added randomness? Preferential skew? To me, it is rather vague, to the point I don't see how it's different from what humans have done for centuries.
Or the opposite, show how those "brilliant insights" from humans manage to survive in the sea of cultural crap otherwise produced in human culture. Perhaps a specific example would help.
This is the pure incredulity that I was talking about.
Humans have been trained on "human-generated data" (cultural artifacts) for centuries, and quality is not down. AI is only an accelerator of this process, but there is nothing inherent in creating "artifacts" that would pollute the original training data.
If anything, we should be worried about destroying nature, because that's the original inspiration for human-produced artifacts.