Re:Figure 01 robot demos its OpenAI integration
by fragmede on Wednesday March 13, 2024 @09:32PM
(#39699717)
Yes, there are two half’s to this. This is being able to understand the command which OK robot shows is possible, and then there’s the control of motors and actuators as you pointed out. Not needing a team of engineers to laboriously write gcode to manipulate motors is part two and is the other astounding thing here. I haven’t been following this sort of thing, so I have no idea what previous state of the art was, so I can’t judge how much of an advancement it really is.
It would be absolutely amazing if they really are at that level of manipulation in general, and it would put them vastly beyond what anyone has been able to do date. However robotics demos have a great history of being a mix of slight of hand (partial/full tele-op), heavily cherry picked, or tuned to a extremely specific example.
Because it's such a leap being implied by this video, it's reasonable to want significantly more evidence before believing they can do this type of interaction and manipulation in a general way. But even if it is heavily leaning say on imitation learning for this exact scenario, there are tons of potential applications for this level of capability.