News for hackers. Stuff that matters.
Re:21.2× faster than llama.cpp? plus 40% memory usage reduction by TOMDM on Wednesday June 12, 2024 @06:41PM (#40663986)
Paper for the sparcified mixtral models

https://arxiv.org/abs/2406.05955

Re:21.2× faster than llama.cpp? plus 40% memory usage reduction by cpldcpu on Wednesday June 12, 2024 @08:14PM (#40664578)
This seems very similar to the other paper.