Re:LLMs Are Cheap
by theOGognf on Monday June 09, 2025 @08:59AM
(#44224040)
Right, this is only power usage. Factoring in labor and all that would make it more expensive for sure. However, it’s not like it’s a complex system to maintain. We use a popular inference server and just run it with some modest rate limits . It’s been hands-off for close to a year at this point
[ Parent
| on HN ]
Re:LLMs Are Cheap
by exceptione on Monday June 09, 2025 @09:05AM
(#44224102)
Ok! What hardware do you run? I had thought that would be the most expensive part.