News for hackers. Stuff that matters.
Re:Gemini 2.0: our new AI model for the agentic era by dagmx on Wednesday December 11, 2024 @12:42PM (#42390442)
Inference costs per invocation aren’t high. Scale it out to billions of users and it’s a different story.

Training is amortized over each inference, so the cost of inference also needs to include the cost of training to break even unless made up elsewhere

There are no comments on this comment yet.