Re:Project Genie: Experimenting with infinite, interactive w...
by WarmWash on Thursday January 29, 2026 @01:32PM
(#46814345)
The actual breakthrough with Genie is being able to turn around and look back, and seeing the same scene that was there before. A few other labs have similar world simulators, but they all struggle badly with keeping coherence of things not in view. Hence why they always walk forwards and never look around.
[ Parent
| on HN ]
Re:Project Genie: Experimenting with infinite, interactive w...
by nozbufferHere on Thursday January 29, 2026 @02:01PM
(#46814845)
Still amazed it took ML people so long to realize they needed and explicit representation to cache stuff.
Re:Project Genie: Experimenting with infinite, interactive w...
by Legend2440 on Thursday January 29, 2026 @02:45PM
(#46815543)
Genie does not use an explicit representation:
>Genie 3’s consistency is an emergent capability. Other methods such as NeRFs and Gaussian Splatting also allow consistent navigable 3D environments, but depend on the provision of an explicit 3D representation. By contrast, worlds generated by Genie 3 are far more dynamic and rich because they’re created frame by frame based on the world description and actions by the user.
Re:Project Genie: Experimenting with infinite, interactive w...
by emmettm on Thursday January 29, 2026 @05:00PM
(#46817320)
The representation is learned. Also, see Sutter's "Bitter Lesson" essay
Re:Project Genie: Experimenting with infinite, interactive w...
by sfn42 on Thursday January 29, 2026 @01:45PM
(#46814566)
And what if I go somewhere then go back there a week later?
Re:Project Genie: Experimenting with infinite, interactive w...
by jsheard on Thursday January 29, 2026 @01:47PM
(#46814597)
Best they can do is 60 seconds, for now at least.
Re:Project Genie: Experimenting with infinite, interactive w...
by autonomousErwin on Thursday January 29, 2026 @02:46PM
(#46815550)
Makes you wonder what the TTL caching for our universe is.
Re:Project Genie: Experimenting with infinite, interactive w...
by dabbz on Thursday January 29, 2026 @03:46PM
(#46816345)
Whatever the speed of light is I would imagine
Re:Project Genie: Experimenting with infinite, interactive w...
by jacquesm on Thursday January 29, 2026 @07:36PM
(#46819070)
No, that's just an optimization that saved on computing resources. It effectively allows the party that runs this simulation to have a limited world to simulate. Dark matter is the other half of that trick. Both were invented by one Bebele Zropaxhodb after a particularly interesting party in the universe just above this one...
Re:Project Genie: Experimenting with infinite, interactive w...
by autonomousErwin on Friday January 30, 2026 @10:04AM
(#46825197)
That's the rendering speed.
Re:Project Genie: Experimenting with infinite, interactive w...
by abraxas on Thursday January 29, 2026 @04:45PM
(#46817097)
What about Fei Fei Li's lab? I think they are generating true 3D worlds rather than frames of a video?
Although that probably precludes her from having animations in those worlds...
Re:Project Genie: Experimenting with infinite, interactive w...
by forrestthewoods on Thursday January 29, 2026 @10:53PM
(#46820353)
Can they? Is there a video of someone standing in place and spinning the camera 1080 degrees?
Re:Project Genie: Experimenting with infinite, interactive w...
by postexitus on Friday January 30, 2026 @06:25AM
(#46823131)
They achieve that by not generating the scene you see, but a lens warped version of 360 degree view. So you turning the other way doesn't delete what's happening / generated on your back side. However I expect it to breakdown if you put a blocker in between and remove it. i.e. go behind a wall and come back, or enter and exit a building. Would be nice to play with.