Re:Localllm lets you develop gen AI apps on local CPUs
by mkatx on Thursday February 08, 2024 @06:01PM
(#39309000)
Yeah, ecc. I do have a lot of data intensive services running. But my systems are mostly amd, and I'm pretty sure my amd CPUs can actually use ecc memory, so I'll probably upgrade some day.
[ Parent
| on HN ]
Re:Localllm lets you develop gen AI apps on local CPUs
by api on Thursday February 08, 2024 @06:27PM
(#39309246)
I've run non-ECC systems at heavy load for uptimes in excess of a year and not had issues. It really is statistically rare... but of course common enough that if you run whole data centers you will see it.