News for hackers. Stuff that matters.
Re:Diffusion Models Are Real-Time Game Engines by PoignardAzur on Wednesday August 28, 2024 @06:15AM (#41377910)
> But it's not a game. It's a memory of a game video, predicting the next frame based on the few previous frames, like "I can imagine what happened next".

It's not super clear from the landing page, but I think it's an engine? Like, its input is both previous images and input for the next frame.

So as a player, if you press "shoot", the diffusion engine need to output an image where the monster in front of you takes damage/dies.

Re:Diffusion Models Are Real-Time Game Engines by bergen on Wednesday August 28, 2024 @08:07AM (#41378565)
How is what you think they say not clear?

We present GameNGen, the first game engine powered entirely by a neural model that enables real-time interaction with a complex environment over long trajectories at high quality.