Re:Cost Per 1M tokens Of Self Hosting Llama-3
by whoiscroberts on Friday June 14, 2024 @09:49PM
(#40686868)
This is great advice. I used to run my dev stuff on AWS, then built a small 6 server proxmox cluster in my basement, 300 cores, 1tb memory, 12tb ssd storage for about 3k usd. I don’t even want to know what it would cost to run a similar config on AWS. You can get cheap ddr4 servers on eBay all day.
[ Parent
| on HN ]
There are no comments on this comment yet.