News for hackers. Stuff that matters.
Re:RebrickNet – Lego Part Detector by amelius on Wednesday October 30, 2024 @08:28AM (#41994118)
I'm curious how far away we are from a robot that can pick up LEGO pieces and stack them together according to the assembly-booklet.

And what kind of DL models would it use?

Re:RebrickNet – Lego Part Detector by wussboy on Wednesday October 30, 2024 @09:52AM (#41994733)
But what would be the point of that, beyond the thrill of building a robot? The joy of LEGO is finding the pieces and building it yourself, not in owning an assembled model.
Re:RebrickNet – Lego Part Detector by fragmede on Wednesday October 30, 2024 @08:35AM (#41994163)
We're a ways away from a hand and arm that dexterous, though there's been promising developments given all the money going into AI lately. We're also a ways away from having a machine "read" a PDF of LEGO instructions and then modeling it as a digital twin. It's being worked on though, so maybe in our lifetimes.

That's an AI I'd rather not see though - that's the fun part OF LEGOs. If you really want a model completed, pay a local teenage (or laid off software dev) to do it.

Re:RebrickNet – Lego Part Detector by amelius on Wednesday October 30, 2024 @08:46AM (#41994235)
> We're a ways away from a hand and arm that dexterous

So you are saying it is not possible to stack LEGO pieces by a remotely controlled arm (with a human operator)?

> That's an AI I'd rather not see though - that's the fun part OF LEGOs

AI is already claiming all the fun tasks like writing poems and drawing kittens ;)

Re:RebrickNet – Lego Part Detector by Freak_NL on Wednesday October 30, 2024 @08:57AM (#41994316)
Have you ever assembled a Lego set rated 8+ or older? It's not about stacking bricks, it's about applying just enough pressure at exactly the right angle, whilst supporting the assembly in the right places. (Something humans can do remarkably well.)

This is something you can probably program an expensive assembly robot to do if it has to repeat that same procedure thousands of times, but doing it for a whole set human operated? That only makes sense if you haven't got a set of nimble appendices and opposable thumbs, and you have the time to spare and inclination to train with the remotely controlled arm. Having an LLM do it seems fruitless at this point — and why bother?

Re:RebrickNet – Lego Part Detector by amelius on Wednesday October 30, 2024 @09:09AM (#41994394)
Obviously, the reason for wanting a LEGO assembly robot is not to assemble LEGO projects, but it's to learn from the technology that makes it possible ...
Re:RebrickNet – Lego Part Detector by elephantum on Wednesday October 30, 2024 @12:46PM (#41997283)
I tried to do brick sorting (because we have great detection and classification models at https://brickit.app/)

It turned out to be much more complex than I expected.

The biggest issue was grabbing. Typical approach for this type of task is to use vacuum suction actuator, but it does not work for Lego parts, because they have stubs and prevent suction from working.

Also there are issues of part separation.

We abandoned this idea, but I still hope that we can return and achieve something working some day.