Re:Jev: New frontier model 40-400x cheaper and 20-200x faster
by adastra22 on Wednesday September 16, 2026 @04:15AM
(#49723454)
AFAICT it is the same interface as you describe, but the underlying inference algorithm is fundamentally different, hence the speed gains. There is an application I am currently working on right now where this typed output predictor is the performance bottleneck. I'd be very interested to see how this performs.
[ Parent
| on HN ]
There are no comments on this comment yet.