Re:Diffusion Models Are Real-Time Game Engines
by bergen on Wednesday August 28, 2024 @08:07AM
(#41378565)
How is what you think they say not clear?
We present GameNGen, the first game engine powered entirely by a neural model that enables real-time interaction with a complex environment over long trajectories at high quality.
It's not super clear from the landing page, but I think it's an engine? Like, its input is both previous images and input for the next frame.
So as a player, if you press "shoot", the diffusion engine need to output an image where the monster in front of you takes damage/dies.