News for hackers. Stuff that matters.
Re:DeepSeek-R1 by bt1a on Tuesday January 21, 2025 @04:48AM (#42778160)
DeepSeek-R1-Distill-Qwen-32B-Q6_K_L.gguf solved this:

In which of the following Incertae sedis families does the letter `a` appear the most number of times?

``` Alphasatellitidae Ampullaviridae Anelloviridae Avsunviroidae Bartogtaviriformidae Bicaudaviridae Brachygtaviriformidae Clavaviridae Fuselloviridae Globuloviridae Guttaviridae Halspiviridae Itzamnaviridae Ovaliviridae Plasmaviridae Polydnaviriformidae Portogloboviridae Pospiviroidae Rhodogtaviriformidae Spiraviridae Thaspiviridae Tolecusatellitidae ```

Please respond with the name of the family in which the letter `a` occurs most frequently

https://pastebin.com/raw/cSRBE2Zy

I used temp 0.2, top_k 20, min_p 0.07

Re:DeepSeek-R1 by DominikPeters on Tuesday January 21, 2025 @09:53AM (#42780737)
Indeed, for each of the words it got it right.
Re:DeepSeek-R1 by bt1a on Tuesday January 21, 2025 @12:31PM (#42782842)
How excellent for a quantized 27GB model (the Q6_K_L GGUF quantization type uses 8 bits per weight in the embedding and output layers since they're sensitize to quantization)