News for hackers. Stuff that matters.

A comment on Outsourcing plus LocalAI will soon become more economical vs. Frontier labs. Parent comment

Re:Outsourcing plus LocalAI will soon become more economical... by jurgenburgen on Wednesday May 27, 2026 @02:30AM (#48290469)
Does more RAM increase performance? This approach sounds like it could eventually be fast enough for local use as hardware and models improve.
[ Parent | on HN ]
Re:Outsourcing plus LocalAI will soon become more economical... by zozbot234 on Wednesday May 27, 2026 @03:46AM (#48290998)
Faster SSD access improves performance more than RAM does, at least until all of the model is being cached in RAM. So older and cheaper HEDT platforms with lots of PCIe lanes to attach storage to are best for this approach.
[ Parent | on HN ]