Re:Stable Fast 3D: Rapid 3D Asset Generation from Single Images
by latentsea on Thursday August 01, 2024 @06:06PM
(#41134137)
>This is an LLM controlling an embodied VR body in a physics simulation.
No it's not. It's VAM that is controlling the character and it's literally just using a bog standard LLM as a chatbot and feeding the text into a plugin in VAM and VAM itself does the animation. Don't get me wrong it's absolutely next level to experience chatbots this way, but it's still a chat bot.
Re:Stable Fast 3D: Rapid 3D Asset Generation from Single Images
by llm_trw on Thursday August 01, 2024 @06:19PM
(#41134232)
The animation, not the movement decisions.
This is as naive as calling an industrial robot 'just a calculator'.
Re:Stable Fast 3D: Rapid 3D Asset Generation from Single Images
by latentsea on Thursday August 01, 2024 @11:51PM
(#41135955)
The movement decisions are also just text from the LLM and are heavily coupled with what's available in the scene. It's not some free autonomous agent. Nor was the movement decisions trained any special type of tokens other than just text.
Let me show you the future: https://www.youtube.com/watch?v=eVlXZKGuaiE
This is an LLM controlling an embodied VR body in a physics simulation.
It is responding to human voice input not only with voice but body movements.
Transformers aren't just chatbots, they are general symbolic manipulation machines. Anything that can be expressed as a series of symbols is a thing they can do.