News for hackers. Stuff that matters.

A comment on Deepseek R1 Distill 8B Q40 on 4 x Raspberry Pi 5, 6.43 tok/s (eval 11.68 tok/s). Parent comment

Re:Deepseek R1 Distill 8B Q40 on 4 x Raspberry Pi 5, 6.43 to... by b4rtazz on Saturday February 15, 2025 @08:17PM (#43064338)
I checked how it performs in long run (prediction) on 4 x Raspberry Pi 5:

* pos=0 => P 138 ms S 864 kB R 1191 kB Connect

* pos=2000 => P 215 ms S 864 kB R 1191 kB .

* pos=4000 => P 256 ms S 864 kB R 1191 kB manager

* pos=6000 => P 335 ms S 864 kB R 1191 kB the

[ Parent | on HN ]

There are no comments on this comment yet.