Re:A single function Jev-like wrapper for LLMs, including vi...
by CROON_tv on Saturday September 26, 2026 @07:07AM
(#49855370)
What I'd want to see next to accuracy is tail latency. In a real-time use, deciding when a spoken sentence is finished, a general LLM with the same prompt was slower and more hesitant for us than Jev, even though both cost about the same.
[ Parent
| on HN ]
There are no comments on this comment yet.