News for hackers. Stuff that matters.
Re:Desert Ant Labs: local, fast models that run on device by pveugen on Wednesday September 09, 2026 @09:36AM (#49626341)
It's an ANE optimized version of Parakeet, with our own inference, which enabled us to push performance to about 300x realtime speed on an iPhone 16/17. Our next gen Voz model is trained from scratch and will be at least twice as fast. Android and other platforms will land soon.
Re:Desert Ant Labs: local, fast models that run on device by sipjca on Wednesday September 09, 2026 @08:16PM (#49636485)
I understand. And inference optimizations are great. It's just that it's not a new model, and that's what I was excited about. I work on cross-platform transcription inference and was hoping for something more than just a re-badged parakeet v3

Look forward to the next model