News for hackers. Stuff that matters.
Re:Localllm lets you develop gen AI apps on local CPUs by eyegor on Wednesday February 07, 2024 @08:38PM (#39296789)
For $1000 you could basically build one today. 5950x (16c cpu) is $400, 128gb kit of ddr4 is $250-300, maybe enough budget left for mobo, ssd, psu, case, cooler if you bought used bits (may also need cheapest gpu on Craigslist depending on your needs). All new ~$1200. Aws/gcp prices are nuts compared to on prem, although hetzner and co would be much cheaper.
Re:Localllm lets you develop gen AI apps on local CPUs by omgwtfbyobbq on Thursday February 08, 2024 @12:23AM (#39298556)
Yeah, Cloud is definitely a money maker.

If someone has a microcenter nearby, they could build an 8 core ddr4 system with 128gb of ram for maybe $800.

$3200+ could build a 64 core/128gb ddr5 rig.

https://www.newegg.com/tyan-s8050gm2ne-9534-amd-epyc-9534-2-...

Re:Localllm lets you develop gen AI apps on local CPUs by RecycledEle on Thursday February 08, 2024 @03:57PM (#39307587)
Price a HP z440 with those specs on eBay or Amazon.