News for hackers. Stuff that matters.
Re:Llama.cpp: Full CUDA GPU Acceleration by lachlan_gray on Monday June 12, 2023 @11:57PM (#36305060)
With any luck projects like MLC will help close the gap

https://github.com/mlc-ai/mlc-llm

There are no comments on this comment yet.