Re:DeepSeek-R1
by bt1a on Tuesday January 21, 2025 @12:31PM
(#42782842)
How excellent for a quantized 27GB model (the Q6_K_L GGUF quantization type uses 8 bits per weight in the embedding and output layers since they're sensitize to quantization)
[ Parent
| on HN ]
There are no comments on this comment yet.