News for hackers. Stuff that matters.

A comment on Ask HN: Which LLM service has the fairest pricing for students?. Parent comment

Re:Ask HN: Which LLM service has the fairest pricing for stu... by sonderotis on Tuesday August 19, 2025 @01:32PM (#44954057)
So you mean firing up ollama and them later if it scales. going for llm service?
[ Parent | on HN ]
Re:Ask HN: Which LLM service has the fairest pricing for stu... by toomuchtodo on Tuesday August 19, 2025 @01:33PM (#44954072)
Yes. I have seen examples of servers for developing countries that host local copies of Wikipedia and other open data sets, as well as an aggressive caching proxy for low bandwidth internet uplinks. Same idea, but local serving of LLM inference.
[ Parent | on HN ]