Re:Llama and ChatGPT Are Not Open-Source
by bick_nyers on Thursday July 27, 2023 @08:37PM
(#36901939)
Just because it is a probability doesn't mean that it's strictly the probability derived from frequency in your training corpus. If you just used that as your model, it would not be nearly as good. Things like reasoning, a world model, and other heuristics can be used to generate said probabilities internally.
All that being said, who is to say that humans aren't just looking at probabilities when they think?
Re:Llama and ChatGPT Are Not Open-Source
by kristopolous on Thursday July 27, 2023 @08:34PM
(#36901919)
Exactly. Especially when there's some hustle behind lying to people. Phony medical advice is the classic one here. People do it to sell their sugar pills or do some Peter Popoff style healing touch hustle.
Some scams, like MLM, encourage massive volumes of this bullshit to be created and disseminated.
The democracy of information does not lead to an increased accuracy based on whatever information spreads the most. The internet is a multi-decade long global proof of this. There's a reason that classrooms have 1 teacher and say 24 students - only 4% of that room is to be trusted with the material.
Because it's not thinking, it's looking at probabilities. If you don't prune branches, you've created a disinformation radiator if that information is sufficiently populous within your corpus to be a pretty-good-bet.
The best analogy I've come up with is "it's like if you had an objective reality based on Wikipedia edit wars."