News for hackers. Stuff that matters.
Re:Gemini 4 Neon by atomashevic on Wednesday November 18, 2026 @05:26PM (#50553182)
Just curious, what TT hardware do you have? How many tps did you achieve with Qwen 3.8 27B?
Re:Gemini 4 Neon by jaykru on Wednesday November 18, 2026 @05:51PM (#50553492)
I'm running 2x p150a's right now. I have them hooked up to a mini-ITX PC with a single PCIe slot via a quad x1 switch (figuring out power to wire up the other two cards I own). My best numbers so far are around 2500t/s prefill about 52t/s decode with DFlash2. All of this is vibecoded besides the original design sketch which was maybe a 3 line description of what tweaks to make to tinygrad and which parts of the existing TT stack to use (almost nothing).