Re:A brief history of LLaMA models
by spudlyo on Saturday April 29, 2023 @09:17PM
(#35758859)
If you want to spend $4800.00 on just the computer, you can get a Mac Studio with 128G of memory with 400GB/s bandwidth. There are sparse reports out there of folks running 65B models on it. I've seen no performance measurements though.
[ Parent
| on HN ]
Re:A brief history of LLaMA models
by AnthonyMouse on Sunday April 30, 2023 @12:50AM
(#35759767)
It's interesting that they actually have it but the price is still silly.
SP5 system board ~$1000
Epyc 9124 $1083
192GB registered DDR5 (12x16GB) ~$1000
case, power supply, modest storage: ~$300
460GB/s bandwidth from 12 memory channels, 50% more memory and you'd have more than $1000 left over. But >$3000 is not a low price either, it's just lower.