Re:OpenAI JalapeñO: Better Than Nvidia Blackwell
by RealityVoid on Tuesday August 25, 2026 @06:13PM
(#49441409)
Talaas, from what I understand is building stuff just like that. The infra is the same and the weights layer is all you need to change. I guess you could half etch the chips and then finish them with the weights only. I think their turnaround is 6-8 Weeks. The size of the models fitting on the chips at the moment is llama 3 I think?
Re:OpenAI JalapeñO: Better Than Nvidia Blackwell
by derefr on Tuesday August 25, 2026 @06:43PM
(#49441693)
> I guess you could half etch the chips and then finish them with the weights only.
Basically a https://en.wikipedia.org/wiki/Gate_array. (The non-field-programmable kind.)
The bigger issue seems to be that these chips can’t hold that many weights at the moment.
(I’m curious if chips with large weights in them would be more tolerant or less to yield issues. If you flip a few bits in the weights, does it really matter at scale?)