News for hackers. Stuff that matters.
Re:Llama.cpp 30B runs with only 6GB of RAM now by jart on Saturday April 01, 2023 @02:09PM (#35402510)
Docker. Don't forget Docker. I pretty much checked out the day using it became a requirement just to talk to a GPU and didn't do much with machine learning until llama.cpp came along.

There are no comments on this comment yet.