News for hackers. Stuff that matters.
Re:WIP: Nvidia Parakeet ASR mode inference in GGML by jasonni on Saturday August 09, 2025 @12:27PM (#44847824)
I'm working on implementing Nvidia's parakeet tdt ASR model inference in GGML framework. The performance result compared to the MLX python version surprised me. My ggml implementation is 1000x slower than the MLX python version. Any help/comments/suggestions are welcome. THanks a lot!

There are no comments on this comment yet.