Re:Localllm lets you develop gen AI apps on local CPUs
by eyegor on Wednesday February 07, 2024 @08:38PM
(#39296789)
For $1000 you could basically build one today. 5950x (16c cpu) is $400, 128gb kit of ddr4 is $250-300, maybe enough budget left for mobo, ssd, psu, case, cooler if you bought used bits (may also need cheapest gpu on Craigslist depending on your needs). All new ~$1200. Aws/gcp prices are nuts compared to on prem, although hetzner and co would be much cheaper.
[ Parent
| on HN ]
Re:Localllm lets you develop gen AI apps on local CPUs
by omgwtfbyobbq on Thursday February 08, 2024 @12:23AM
(#39298556)
Yeah, Cloud is definitely a money maker.
If someone has a microcenter nearby, they could build an 8 core ddr4 system with 128gb of ram for maybe $800.
$3200+ could build a 64 core/128gb ddr5 rig.
https://www.newegg.com/tyan-s8050gm2ne-9534-amd-epyc-9534-2-...
Re:Localllm lets you develop gen AI apps on local CPUs
by RecycledEle on Thursday February 08, 2024 @03:57PM
(#39307587)
Price a HP z440 with those specs on eBay or Amazon.