News for hackers. Stuff that matters.
Re:Genie 2: A large-scale foundation world model by pelorat on Wednesday December 04, 2024 @02:18PM (#42320957)
This is akin to navigating a lucid dream, nothing more. Conscious inputs to a visual stream synthesized from long term memory.
Re:Genie 2: A large-scale foundation world model by nomel on Wednesday December 04, 2024 @04:51PM (#42322424)
> nothing more.

Consider the use where you seed the first frame from a real world picture, with a prompt that gives it a goal. Not only can you see what might happen, with different approaches, and then pick one, but you can re-seed with real world baselines periodically as you're actually executing that action to correct for anything that changes. This is a great step for real world agency.

As a person without aphantasia, this is how I do anything mechanical. I picture what will happen, try a few things visually in my head, decide which to do, and then do it for real. This "lucid dream" that I call my imagination is all based on long term memory that made my world view. I find it incredibly valuable. I very much rely on it for my day job, and try to exercise it as much as possible, before, say, going to a whiteboard.