News for hackers. Stuff that matters.

A comment on Localllm lets you develop gen AI apps on local CPUs. Parent comment

Re:Localllm lets you develop gen AI apps on local CPUs by api on Thursday February 08, 2024 @07:20AM (#39301084)
Without memory safety? Do you mean ECC?

Non-ECC issues are statistically rare. You might never see them if you aren’t running a lot of systems at heavy load at scale.

[ Parent | on HN ]
Re:Localllm lets you develop gen AI apps on local CPUs by mkatx on Thursday February 08, 2024 @06:01PM (#39309000)
Yeah, ecc. I do have a lot of data intensive services running. But my systems are mostly amd, and I'm pretty sure my amd CPUs can actually use ecc memory, so I'll probably upgrade some day.
[ Parent | on HN ]
Re:Localllm lets you develop gen AI apps on local CPUs by api on Thursday February 08, 2024 @06:27PM (#39309246)
I've run non-ECC systems at heavy load for uptimes in excess of a year and not had issues. It really is statistically rare... but of course common enough that if you run whole data centers you will see it.
[ Parent | on HN ]