News for hackers. Stuff that matters.
Re:Genie 2: A large-scale foundation world model by wongarsu on Wednesday December 04, 2024 @03:09PM (#42321503)
Oasis (the Minecraft world model) can serve about 5 players on 8 H100 in real-time at 20fps in 360p. This is a much more capable model with two orders of magnitude more context. They pretty much say it can't be played real-time, which I read as they generate less than 15fps@240p on 8 GPUs. Probably why they talk so much about using it for AI training and evaluation rather than human use. There is a distilled version that works in real-time, but they don't show anything from that version (which is a statement in itself).

For reducing the price, ASICs like etched may be the way forwards [1]. The models will get bigger for a time, but there may be a lot of room for models that can exploit purpose-built hardware.

1: https://www.etched.com

Re:Genie 2: A large-scale foundation world model by onlyrealcuzzo on Wednesday December 04, 2024 @03:37PM (#42321777)
> Probably why they talk so much about using it for AI training and evaluation rather than human use.

What would they do / how would they use this output to make a better AI?

Re:Genie 2: A large-scale foundation world model by bionhoward on Wednesday December 04, 2024 @07:05PM (#42323418)
Embodied cognition is a core theory for AGI; this would enable a vast array of bodies, environments, and situations, that high level of diversity can empower AI adaptability.

For a straightforward example, this could help Waymo rehearse driving in various cities and weather / traffic settings

Re:Genie 2: A large-scale foundation world model by Rastonbury on Wednesday December 04, 2024 @09:50PM (#42324318)
Not meaning to pick at that example but a broader question the value of these, what use cases outside of games are they willing to let AI that is meant to interact with the real world be trained on AI synthetic data, that is like black box on black box, double the training and inference cost

Even in games I expect a game playing model to exploit glitches present in world building one

I think it's great that Google is researching these, but I can't see the return and if there is it is many steps away

Re:Genie 2: A large-scale foundation world model by nine_k on Thursday December 05, 2024 @12:03AM (#42325146)
I bet the military is keenly interested.
Re:Genie 2: A large-scale foundation world model by latchkey on Wednesday December 04, 2024 @04:34PM (#42322276)
Hey! I'd love to know how this performs on 8xMI300x in comparison. Reach out to me?