News for hackers. Stuff that matters.

A comment on A 10 year old Xeon is all you need (for 26B-A4B MTP Drafters without GPU). Parent comment

Re:A 10 year old Xeon is all you need (for 26B-A4B MTP Draft... by throwawayffffas on Monday June 01, 2026 @03:17PM (#48361328)
He meant prompt eval time, but have a look at these guys: https://www.youtube.com/watch?v=ndSA9T5yvmM

Over 2500 tokens per second on a single request. With 8 MI300X.

[ Parent | on HN ]

There are no comments on this comment yet.