Re:Richard Sutton and Andrew Barto Win 2024 Turing Award
by visarga on Wednesday March 05, 2025 @11:29AM
(#43268777)
> if you do AI research with the idea that by teaching machines how to do X, we might also be able to gain insight in how people do X, then ever more complex statistical setups will be of limited information
At the very least we know consistent language and vision abilities don't require lived experience. That is huge in itself, it was unexpected.
Re:Richard Sutton and Andrew Barto Win 2024 Turing Award
by kleiba on Wednesday March 05, 2025 @02:47PM
(#43271359)
Is that true though given e.g. the hallucinations you regularly get from LLMs?
Re:Richard Sutton and Andrew Barto Win 2024 Turing Award
by probably_wrong on Wednesday March 05, 2025 @05:19PM
(#43273469)
> At the very least we know consistent language and vision abilities don't require lived experience.
I don't think that's true. A good chunk of the progress done in the last years is driven by investing thousand of man-hours asking them "Our LLM failed at answering X. How would you answer this question?". So there's definitely some "lived experience by proxy" going on.
But if you do AI research with the idea that by teaching machines how to do X, we might also be able to gain insight in how people do X, then ever more complex statistical setups will be of limited information.
Note that I'm not taking either point of view here. I just want to point out that perhaps a more nuanced approach might be called for here.