The 'renderer' would be a neural net that would take this soup of tokens, and resolve it to a 2d frame.
The underlying logic engine would be a human one - or perhaps a traditional video game engine, that emits the tokens from which the context can be built up and decoded into an image.
Wan video is a brand new open weights model that is developing a nice research and tooling ecosystem around it. Netflix has been playing with it. Further research and tooling will be built on top of it for sure.
Sora is garbage (currently [1]) and Runway, Luma, and Pika are mid. Pika kind of left the race to focus on social media content and memes.
There are a bunch of other stealth / research foundation models that will be rolling out soon. It's a hyper competitive market and consumers are going to win.
[1] Given the insane capabilities of the just released OpenAI 4o image gen, I expect the next Sora to be impressive.
Can't help but flashback to when Sora was first previewed and the hype crew were claiming it was a world physics engine and now when it finally shipped months and months later no one uses it and it didn't deliver on any of the hype at all.