Re:Deepseek R1-0528
by CamperBob2 on Wednesday May 28, 2025 @03:41PM
(#44119931)
Your 1.58-bit dynamic quant model is a religious experience, even at one or two tokens per second (which is what I get on my 128 MB Raptor Lake+4090). It's like owning your own genie... just ridiculously smart. Thanks for the work you've put into it!
[ Parent
| on HN ]
Re:Deepseek R1-0528
by danielhanchen on Wednesday May 28, 2025 @03:43PM
(#44119947)
Oh thank you! :) Glad they were useful!
Likewise - for me, it feels how I imagined getting a microcomputer in the 70s was like.
Re:Deepseek R1-0528
by danielhanchen on Wednesday May 28, 2025 @09:14PM
(#44122144)
:) The good ol days!