Those demos are put out by non-engineer AI-bros who start from a blank slate and just test raw one-shot performance of the model.

In comparison I'm aware of how much additional performance you can extract out of models with a team of professional engineers that are balls-deep in harness engineering.

That delta is very large.

It's exciting.