Re:MK-1
by lolinder on Saturday August 05, 2023 @06:22PM
(#37016823)
For sure, but I couldn't find numbers for the K quants that included inference speeds, so I settled on the older one. If MK-1 were trying to be honest they'd definitely want to benchmark against the newest methods!
https://old.reddit.com/r/LocalLLaMA/comments/142q5k5/updated...