Software and algorithmic improvements diffuse faster than hardware, even with attempts to keep them secret. Maybe a company doubles the efficiency, but in 3 months, it's leaked and everyone is using it. And then the compute edge becomes that much more durable.
Re:Grok3 Launch
by mirekrusin on Tuesday February 18, 2025 @11:46AM
(#43091889)
Optimisation efforts don’t negate investment in capacity but multiply output.
Sorry, you missed the point - DeepSeek tried some new software ideas, they did not manage to secure the same computation capacity.
https://centreforaileadership.org/resources/deepseeks_narrat...
If you’re using your compute capacity at 1.25% efficiency, you are not going to win because your iteration time is just going to be too long to stay competitive.