News for hackers. Stuff that matters.
Re:Llama2.c: inference llama 2 in one file of pure C by franga2000 on Sunday July 23, 2023 @06:21PM (#36840505)
This only matters if you're scaling to meet demand and demand is higher than your spare resources, which often isn't the case for hobby projects. The 10€/mo VPS I've had for over 6 years now still has a few cores and GBs or RAM spare, so running a small model on the CPU for a personal project that only me and a few friends occasionally use wouldn't cost me a cent more.
Re:Llama2.c: inference llama 2 in one file of pure C by immibis on Monday July 24, 2023 @02:30AM (#36843784)
FYI, the going rate for "smallest possible VPS" is now more like 3€/mo.