Re:Jev: New frontier model 40-400x cheaper and 20-200x faster
by someguynamedq on Wednesday September 16, 2026 @06:44AM
(#49724547)
The impressive part is that it is low latency enough to serve high quality answers at game speed through the model instead of a pre generated ad-hoc machine.
[ Parent
| on HN ]
Re:Jev: New frontier model 40-400x cheaper and 20-200x faster
by bigglebear on Thursday September 17, 2026 @08:05AM
(#49739579)
A pre-generated machine can serve the answers in <1ms. It's a far better strategy.