News for hackers. Stuff that matters.
Re:Ask HN: Which LLM service has the fairest pricing for stu... by toomuchtodo on Tuesday August 19, 2025 @01:25PM (#44953973)
What would be the cost for you to self host and serve locally on a network? It's potentially more cost effective to aggregate resources to host "on prem" vs the ongoing SaaS costs.
Re:Ask HN: Which LLM service has the fairest pricing for stu... by sonderotis on Tuesday August 19, 2025 @01:32PM (#44954057)
So you mean firing up ollama and them later if it scales. going for llm service?
Re:Ask HN: Which LLM service has the fairest pricing for stu... by toomuchtodo on Tuesday August 19, 2025 @01:33PM (#44954072)
Yes. I have seen examples of servers for developing countries that host local copies of Wikipedia and other open data sets, as well as an aggressive caching proxy for low bandwidth internet uplinks. Same idea, but local serving of LLM inference.