Re:Please ignore the deluge of complete nonsense about Q*
by blueblisters on Saturday November 25, 2023 @01:40PM
(#38415469)
Can you cite a reference for that quote? I can’t find it. He has definitely underestimated language model capabilities but he has been mostly right on the “language models can’t plan” stuff. He has been consistent and correct about his criticism about auto regressive model as well.
Re:Please ignore the deluge of complete nonsense about Q*
by agnosticmantis on Monday November 27, 2023 @08:42AM
(#38432156)
He’s said it’s easy to generate this kind of questions that trick LLMs because of the lack of physical grounding in models trained solely on text.
And that’s true now as ever. I also heard him say that training multimodal models on text+image/video would mitigate the grounding issue, and that’s proven to be true too.
So I’m not sure exactly what your objection is.
Lost respect for his opinions massively after seeing how he lied about the topic.