News for hackers. Stuff that matters.
Re:Deepseek R1-0528 by phonon on Wednesday May 28, 2025 @07:33PM (#44121551)
This is the state of the art for such a setup. Really good performance!

https://github.com/kvcache-ai/ktransformers

There are no comments on this comment yet.