Re:Toyota Unveils Breakthrough in Teaching Robots New Behaviors
by mdonahoe on Wednesday September 20, 2023 @09:10PM
(#37592096)
> our lab
Which lab are you referring to?
Re:Toyota Unveils Breakthrough in Teaching Robots New Behaviors
by momofuku on Wednesday September 20, 2023 @09:55PM
(#37592388)
I meant the academic lab that I was a part of while in grad school (would like to keep that anonymous for now, it's a smallish community).
Btw, I was at R:SS 2022 and meeting the Skydio autonomy team was one of the highlights of my career as a robotics engineer!
Re:Toyota Unveils Breakthrough in Teaching Robots New Behaviors
by srsqsonyl on Wednesday September 20, 2023 @09:53PM
(#37592380)
You may as well credit the information theorists, mathematicians, and physicists who laid out the fundamentals that brought us here.
They died before hardware achieved their decades old visions. Not much of this work is net new description, moreso normalizing old descriptions with observation now that we can actually build the old ideas.
Re:Toyota Unveils Breakthrough in Teaching Robots New Behaviors
by 3seashells on Thursday September 21, 2023 @12:53AM
(#37593366)
Prompt: ChatGpt write a generic anti academia rant against robotics research
Re:Toyota Unveils Breakthrough in Teaching Robots New Behaviors
by snor on Thursday September 21, 2023 @01:27AM
(#37593521)
This is a good comment, but it should be noted that Diffusion Policy (not to mention IRP) was also apparently joint work with TRI.
Re:Toyota Unveils Breakthrough in Teaching Robots New Behaviors
by yellow_lead on Thursday September 21, 2023 @01:28AM
(#37593528)
To be fair, they do credit Professor Song and the paper you linked. TRI is also listed as a collaborator on the paper.
> Diffusion Policy: TRI and our collaborators in Professor Song’s group at Columbia University developed a new, powerful generative-AI approach to behavior learning. This approach, called Diffusion Policy, enables easy and rapid behavior teaching from demonstration.
Re:Toyota Unveils Breakthrough in Teaching Robots New Behaviors
by prox on Thursday September 21, 2023 @03:11AM
(#37594176)
Interesting that we have a genius robotics Dr. Song for real vs Star Treks Dr. Soong :)
Re:Toyota Unveils Breakthrough in Teaching Robots New Behaviors
by dotancohen on Thursday September 21, 2023 @03:19AM
(#37594235)
I'm glad that she skipped Dr. Soong's ambition that preceded his work on robotics!
Re:Toyota Unveils Breakthrough in Teaching Robots New Behaviors
by ben_w on Thursday September 21, 2023 @06:19AM
(#37595627)
My dad, who worked on military IFF before he retired, met someone in the UK intelligence community whose actual name was James Bond.
Or so he said…
Re:Toyota Unveils Breakthrough in Teaching Robots New Behaviors
by michalu on Saturday September 23, 2023 @04:41AM
(#37621624)
There's actually 1000+ people named James Bond so it's likely. Although fathers are the biggest liars - mine told me he swam across the ocean.
Re:Toyota Unveils Breakthrough in Teaching Robots New Behaviors
by 3abiton on Thursday September 21, 2023 @03:14AM
(#37594202)
It seems some researchers in her lab were also involved with Toyota.
Re:Toyota Unveils Breakthrough in Teaching Robots New Behaviors
by tomp on Thursday September 21, 2023 @04:41AM
(#37594868)
Can anyone ELI5 (well, or, "explain like I'm someone who understands how autoencoders, transformers & convolutional networks work") diffusion?
What makes it work so much better than alternatives mentioned above?
Re:Toyota Unveils Breakthrough in Teaching Robots New Behaviors
by Paluth on Thursday September 21, 2023 @07:38AM
(#37596158)
I haven't read the paper on Policy Diffusion yet so I don't know what they do differently. But I can ELI5 image diffusion models, like stable diffusion. Essentially you add random noise to an image, and the ask the model to predict the noise, such that if you remove that noise detected by the model, you obtain the original image. After the model has been trained enough, int the noise removal task, you can pass just random noise, ask the model to remove noise from the noise only image, then remove a little bit of the noise the model suggested, and do it again. And again, for multiple steps, eventually all the noise is removed and you end up with an image "dreamed" by the model from random noise. You can also condition the noise removal with things like text or other images to guide the noise removal process toward a certain target image.
The core of these advancements are powered by Diffusion Policy [1], which Prof. Shuran Song's lab at Columbia (before she moved recently to Stanford) developed and pioneered. I'd suggest everyone to view the original project website [2], it has a ton of amazing real world challenging experiments.
It was a community favorite for the Best Paper Award at the R:SS conference [3], this year. I remember our lab (and all other learning labs in our robotics department), absolutely dissecting this paper. I know of people who've entirely pivoted away from their projects involving behavior cloning/imitation learning, to this approach, which deals with multi-modal action spaces much more naturally than the aforementioned approaches.
Prof. Song is an absolute rockstar in robotics right now, with several wonderful approaches that scale elegantly to the real world, including IRP [4] (which won Best Paper at R:SS 2022), FlingBot [5], Scaling Up Distilling Down [6] and much more. I recommend checking out her lab website too.
[1] - https://arxiv.org/abs/2303.04137
[2] - https://diffusion-policy.cs.columbia.edu/
[3] - https://roboticsconference.org/program/awards/
[4] - https://irp.cs.columbia.edu/
[5] - https://flingbot.cs.columbia.edu/
[6] - https://www.cs.columbia.edu/~huy/scalingup/