News for hackers. Stuff that matters.

A comment on AI masters Minecraft: DeepMind program finds diamonds without being taught. Parent comment

Re:AI masters Minecraft: DeepMind program finds diamonds wit... by danijar on Monday April 07, 2025 @06:26PM (#43616621)
When it dies it loses all items and the world resets to a new random seed. It learns to stay alive quite well but sometimes falls into lava or gets killed by monsters.

It only gets a +1 for the first iron pickaxe it makes in each world (same for all other items), so it can't hack rewards by repeating a milestone.

Yeah it's surprising that it works from such sparse rewards. I think imagining a lot of scenarios in parallel using the world model does some of the heavy lifting here.

[ Parent | on HN ]
Re:AI masters Minecraft: DeepMind program finds diamonds wit... by SpaceManNabs on Monday April 07, 2025 @10:15PM (#43617764)
> Yeah it's surprising that it works from such sparse rewards. I think imagining a lot of scenarios in parallel using the world model does some of the heavy lifting here.

This is such gold. Thanks for sharing. Immediately added to my notes.

[ Parent | on HN ]