Re:Gemini 2.0: our new AI model for the agentic era
by whimsicalism on Wednesday December 11, 2024 @12:28PM
(#42390278)
but inference costs arent high already and there are tons of hardware companies that can do relatively cheap LLM inference
Re:Gemini 2.0: our new AI model for the agentic era
by dagmx on Wednesday December 11, 2024 @12:42PM
(#42390442)
Inference costs per invocation aren’t high. Scale it out to billions of users and it’s a different story.
Training is amortized over each inference, so the cost of inference also needs to include the cost of training to break even unless made up elsewhere
training doesn’t matter if inference costs are high and people don’t pay for them