Re:AI Is Smoke and Mirrors
by dinobones on Monday April 22, 2024 @12:46PM
(#40116097)
"But it hallucinates!!!!!"
Yeah, and it's getting quantitatively better, all the time. There is a clear progress curve.
Go back and look at the comical quality of GPT2 outputs, and the things people were getting excited about on Twitter. I wrote GPT off at the time because it just seemed like Markov model shenanigans to me, then I tried GPT3.5 and had my mind blown (but was still skeptical due to all the hallucinations), and GPT4 has finally convinced me that this is inevitable, and it's now just an iterative improvement game.
Yeah, and it's getting quantitatively better, all the time. There is a clear progress curve.
Go back and look at the comical quality of GPT2 outputs, and the things people were getting excited about on Twitter. I wrote GPT off at the time because it just seemed like Markov model shenanigans to me, then I tried GPT3.5 and had my mind blown (but was still skeptical due to all the hallucinations), and GPT4 has finally convinced me that this is inevitable, and it's now just an iterative improvement game.