Re:Outsourcing plus LocalAI will soon become more economical...
by zozbot234 on Wednesday May 27, 2026 @03:46AM
(#48290998)
Faster SSD access improves performance more than RAM does, at least until all of the model is being cached in RAM. So older and cheaper HEDT platforms with lots of PCIe lanes to attach storage to are best for this approach.
[ Parent
| on HN ]
There are no comments on this comment yet.