News for hackers. Stuff that matters.
Re:Figure 01 robot demos its OpenAI integration by huytersd on Wednesday March 13, 2024 @12:51PM (#39693968)
How though. It’s probably just predefined actions that are triggered by the LLM output. At the same time it would be impressive if the LLM determined the right function to call in real time, was able to deal with the ambiguity in placement of the garbage and bonus points if it could do that in a scenario that wasn’t hardcoded to exactly standing behind that table in that spot.
Re:Figure 01 robot demos its OpenAI integration by og_kalu on Wednesday March 13, 2024 @12:56PM (#39694066)
The robot movements are separate end-to-end neural networks. They're triggered by the LLM but aren't hardcoded.
Re:Figure 01 robot demos its OpenAI integration by margorczynski on Wednesday March 13, 2024 @01:31PM (#39694558)
Why does it then after performing an action or whole plan return to the "default" position with the hands in that strange stance? Looks kinda like there is some "hard coded" flow that simply uses the LLM(s) to perform actions.
Re:Figure 01 robot demos its OpenAI integration by og_kalu on Wednesday March 13, 2024 @03:44PM (#39696437)
That's a closed loop operation. It's pretty common to train these robots on closed loop demonstrations.
Re:Figure 01 robot demos its OpenAI integration by huytersd on Wednesday March 13, 2024 @01:56PM (#39694925)
Do you know this for a fact or are you speculating?
Re:Figure 01 robot demos its OpenAI integration by StarCyan on Wednesday March 13, 2024 @03:30PM (#39696268)
One of the Figure engineers described the system at a high level: https://twitter.com/coreylynch/status/1767927506332721154