Re:Gemini 2.0: our new AI model for the agentic era
by whimsicalism on Wednesday December 11, 2024 @12:28PM
(#42390278)
but inference costs arent high already and there are tons of hardware companies that can do relatively cheap LLM inference
[ Parent
| on HN ]
Re:Gemini 2.0: our new AI model for the agentic era
by dagmx on Wednesday December 11, 2024 @12:42PM
(#42390442)
Inference costs per invocation aren’t high. Scale it out to billions of users and it’s a different story.
Training is amortized over each inference, so the cost of inference also needs to include the cost of training to break even unless made up elsewhere