Re:Genie 2: A large-scale foundation world model
by reissbaker on Wednesday December 04, 2024 @07:48PM
(#42323670)
They don't give much info on parameter count, etc so it's hard to say concretely: Oasis (AI Minecraft) apparently runs on a single H100 [1], but this is presumably much larger — both due to higher fidelity, and due to the 60s context window instead of 1s context window for Oasis. But in 5-10 years regardless of what it takes to run now, the price will drop massively, and my bet is this would be playable in real-time. Context length will be solvable simply by increased VRAM (i.e. an H200 has 141GB per GPU, vs 80GB for an H100). Although Google is probably running these on TPUs, TPUs should follow a similar trajectory.
In the intermediate term my guess is that this kind of world model will be useful for training 3D model generators, so that you can go from sketch -> running in-engine extremely quickly.
In the intermediate term my guess is that this kind of world model will be useful for training 3D model generators, so that you can go from sketch -> running in-engine extremely quickly.
1: https://www.tweaktown.com/news/101466/oasis-ai-and-single-nv...