News for hackers. Stuff that matters.
Re:OpenAI JalapeñO: Better Than Nvidia Blackwell by andsoitis on Tuesday August 25, 2026 @09:24PM (#49443049)
> For example, GPT Sol baked into a custom chip run for $100M that runs 10x as fast and 10x as cheap should pay for itself as long as the chip is useful for long enough.

but you trade updatability, which I don't think is worth it yet.

Re:OpenAI JalapeñO: Better Than Nvidia Blackwell by mchusma on Tuesday August 25, 2026 @10:09PM (#49443334)
Maybe! (1) Would SOL level intelligence be useful 3 years from now? 5 years? (2) would dedicated chips be the most affordable way to run this model in 3-5 years?

I suspect the answer to both of these questions is yes right now, but I agree it’s borderline.

Re:OpenAI JalapeñO: Better Than Nvidia Blackwell by andsoitis on Tuesday August 25, 2026 @10:16PM (#49443378)
3 years is an eternity.
Re:OpenAI JalapeñO: Better Than Nvidia Blackwell by imtringued on Wednesday August 26, 2026 @02:27AM (#49444817)
LoRAs are a parameter efficient way to update models. The fine tuning stopgap only has to work long enough to extend the lifespan of a model until the next chip comes out.