News for hackers. Stuff that matters.
Re:LLMs Are Cheap by JimDabell on Tuesday June 10, 2025 @04:37AM (#44234155)
I added “indefinitely” precisely because I wanted to rule out discussion of the free credits. Those are clearly a loss-leader to get people to choose AWS and isn’t relevant to how the true cost of inference.
Re:LLMs Are Cheap by maccard on Tuesday June 10, 2025 @08:13AM (#44235828)
The point is that all of these projects are only viable when salaries are VC funded and the opex of inference is close to 0. It’s easy to say that nobody will subsidise inference if you exclude the main subsidies