Re:VibeThinker: 3B param model that beats Opus 4.5 on reason...
by NotSuspicious on Tuesday June 23, 2026 @01:16AM
(#48640611)
The interesting thing about models this small is they should be able to be put on a single Taalas chip (the HC1 already runs a Llama 3.1 8B model). We're already at the point where half-decent reasoning could be run on an ASIC (and at mind-boggling speeds).
[ Parent
| on HN ]
Re:VibeThinker: 3B param model that beats Opus 4.5 on reason...
by pants2 on Tuesday June 23, 2026 @01:53AM
(#48640892)
Yeah, if they can fit an 8B model that's really good at improving the output by thinking, running at 16K tok/s on Taalas would be mind-blowing.
Re:VibeThinker: 3B param model that beats Opus 4.5 on reason...
by le-mark on Tuesday June 23, 2026 @06:53AM
(#48643062)
Given this and the quality of open models, it makes no sense to me that there’s a future for Anthropic et all?
Re:VibeThinker: 3B param model that beats Opus 4.5 on reason...
by james_marks on Tuesday June 23, 2026 @08:31AM
(#48643988)
Packaging a capability into a consumable form will still be business.
It's like web hosting; all the open source tools are there and free, and yet website tools, hosts, etc flourish.
Re:VibeThinker: 3B param model that beats Opus 4.5 on reason...
by WhiteDawn on Tuesday June 23, 2026 @08:59AM
(#48644305)
It’s true, but hosting prices are still within spitting distance of rolling it yourself.
SOTA providers are expecting some level of margin. Companies everywhere have a tight eye on their AI bills right now.
The motivation is there if the models get good enough, even if it’s more painful.
Re:VibeThinker: 3B param model that beats Opus 4.5 on reason...
by CamperBob2 on Tuesday June 23, 2026 @05:28PM
(#48651714)
Exactly, it's like web hosting.
And I don't see a lot of web hosts with twelve-digit valuations.