Re:A 10 year old Xeon is all you need (for 26B-A4B MTP Draft...
by Majromax on Monday June 01, 2026 @09:54AM
(#48356901)
> Seven tokens long input isn't very realistic, is it?
The test prompt above was "Why is the sky blue?", so there's the seven tokens. I meant to highlight that because I'd expect processing of a thousand-token input to be faster per token than presented.
The test prompt above was "Why is the sky blue?", so there's the seven tokens. I meant to highlight that because I'd expect processing of a thousand-token input to be faster per token than presented.