News for hackers. Stuff that matters.
Re:I Run LLMs Locally by drillsteps5 on Tuesday December 31, 2024 @12:43AM (#42556692)
You got it backwards. Training is extremely costly in many different ways, while running inference is much less expensive. Meta, Google, Alibaba, and some others train their models and put them into the open for free burning through their cash reserves trying hard not to lose it all to OpenAI (and MSFT).
Re:I Run LLMs Locally by alkonaut on Wednesday January 01, 2025 @01:41PM (#42568073)
Yes I phrased it backwards in the first sentence (of course). So the answer is ”investor money to operate at a loss?”