News for hackers. Stuff that matters.
Re:Jev: New frontier model 40-400x cheaper and 20-200x faster by adastra22 on Wednesday September 16, 2026 @04:15AM (#49723454)
AFAICT it is the same interface as you describe, but the underlying inference algorithm is fundamentally different, hence the speed gains. There is an application I am currently working on right now where this typed output predictor is the performance bottleneck. I'd be very interested to see how this performs.

There are no comments on this comment yet.