Re:Parakeet.cpp – Parakeet ASR inference in pure C++ with Me...
by jasonni on Friday February 27, 2026 @10:45PM
(#47190064)
The python MLX version of Parakeet indeed support streaming: https://github.com/senstella/parakeet-mlx
It requires modification of the inference algorithm. In this implementation, I see the author even uses a custom metal kernerl to get maximum performance.
The Parakeet model batch inference logic is simple. But for streaming, it may require some effort to get the best performance. It's not only the depencency issue.
[ Parent
| on HN ]
There are no comments on this comment yet.