News for hackers. Stuff that matters.

A comment on What is RT-2? Google DeepMind’s vision-language-action model for robotics. Parent comment

Re:What is RT-2? Google DeepMind’s vision-language-action mo... by Xeophon on Friday July 28, 2023 @11:10AM (#36907930)
Related work is the planning paper by Valmeekan et al [1]. The gist is that LLMs are incapable of planning, which is due to their autoregressive nature. METAs Head of AI Yann Lecun also talks about this topic in a talk [2]. As RT2 is based on a similar architecture, I think the results will be similar.

[1] https://arxiv.org/abs/2305.15771 [2] https://youtu.be/x10964w00zk

[ Parent | on HN ]
Re:What is RT-2? Google DeepMind’s vision-language-action mo... by itissid on Friday July 28, 2023 @11:23AM (#36908205)
That arxiv link to the paper is also the same guy I mentioned in my twitter reference. Subbarao :)
[ Parent | on HN ]