Many benchmarks are already saturated today on many tedious tasks still being done by humans across the world. Frontier labs are introducing their own budget options prior to IPO, undercutting their revenue, because otherwise they risk losing seats.
Choosing what to do and how to do it is the actual frontier now and is still not apparently well supported in any model. Current so-called decision models are not decision models, they are available-fact-evaluating models.
Exactly my point, think the easy things won't even need 3rd party apis in the near future.
But frontier models only seem to need more and more VRAM to keep winning the race. Feel free to look up the cost of running Kimi K3 open weights today, probably the best estimate known publicly, it's hardly a casual affair.