News for hackers. Stuff that matters.
Re:OpenAI JalapeñO: Better Than Nvidia Blackwell by htrp on Tuesday August 25, 2026 @04:06PM (#49439870)
etched tried this.... it didn't go very well
Re:OpenAI JalapeñO: Better Than Nvidia Blackwell by anukin on Tuesday August 25, 2026 @06:55PM (#49441801)
I would assume asic based llm would work really well. Why did it not go well?
Re:OpenAI JalapeñO: Better Than Nvidia Blackwell by striking on Tuesday August 25, 2026 @07:44PM (#49442266)
https://chatjimmy.ai/ runs Llama 3.1-8B on an ASIC as a demo by https://taalas.com/ I believe.

That's quite a few parameters shy of today's trillion-weight behemoths, but it is fast.

Re:OpenAI JalapeñO: Better Than Nvidia Blackwell by mchusma on Tuesday August 25, 2026 @10:33PM (#49443503)
You are correct. I think this is the bull case. It seems like this would be useful right now for some things (eg moderation).