Many benchmarks are already saturated today on many tedious tasks still being done by humans across the world. Frontier labs are introducing their own budget options prior to IPO, undercutting their revenue, because otherwise they risk losing seats.
Choosing what to do and how to do it is the actual frontier now and is still not apparently well supported in any model. Current so-called decision models are not decision models, they are available-fact-evaluating models.
Exactly my point, think the easy things won't even need 3rd party apis in the near future.
But frontier models only seem to need more and more VRAM to keep winning the race. Feel free to look up the cost of running Kimi K3 open weights today, probably the best estimate known publicly, it's hardly a casual affair.
Don't forget that it's a hypothesis, not a foregone conclusion, that this will stop. Part of the question is whether demand will continue to rise. If volume increases sufficiently, you can cut prices and improve profits at the same time, as long as you continue to make a profit at the margin.
Moore's Law kept Intel and competitors pushing R&D budget that pushed perf/watt year after year because the overall computing market just kept growing and growing. The growing demand soaked up everything Intel and co. pushed into the market; the R&D spend helped players retain market share in the face of competition. Why do you think AI is different? R&D into better, faster, cheaper chips brings down the cost of both training and inference over time, and cheaper token cost unlocks additional demand, which justifies more R&D budget, in a virtuous cycle. It continues until there's really no more demand to be unlocked, no more improvements can be made to the chips (i.e. you hit the laws of physics), or there's no more money to be invested (i.e. even capital markets have limits, with only so much cash in circulation, or macro interference like war).
Do we really have any reason to believe that demand will taper off?
How long do you think that will last?
Am over 11 billion tokens this month on a subscription. In API usage its close to $5000 and there's still 13 days left in the month.
Eventually the music in musical chairs stops. Already many anecdotal reports of the always opaque limits being lowered across the board. On a gemini pro account for personal use I can use a weeks worth of Argon in about 20 minutes on agy.