News for hackers. Stuff that matters.

A comment on Mistral: Our first AI endpoints are available in early access. Parent comment

Re:Mistral: Our first AI endpoints are available in early ac... by brandall10 on Monday December 11, 2023 @01:23PM (#38603348)
I get 40 tok/sec on my M3 Max on various 34B models, I gather a desktop 4090 would be at least 80?
[ Parent | on HN ]

There are no comments on this comment yet.