Parakeet.cpp – Parakeet ASR inference in pure C++ with Metal GPU acceleration

Re:Parakeet.cpp – Parakeet ASR inference in pure C++ with Me... by noahkay13 on Thursday February 26, 2026 @10:48PM (#47176240)

I built a C++ inference engine for NVIDIA's Parakeet speech recognition models using Axiom(https://github.com/Frikallo/axiom) my tensor library.

What it does: - Runs 7 model families: offline transcription (CTC, RNNT, TDT, TDT-CTC), streaming (EOU, Nemotron), and speaker diarization (Sortformer) - Word-level timestamps - Streaming transcription from microphone input - Speaker diarization detecting up to 4 speakers

[ Parent | on HN ]

Re:Parakeet.cpp – Parakeet ASR inference in pure C++ with Me... by aaronbrethorst on Friday February 27, 2026 @02:52AM (#47177798)

I see a number of references to macOS support in your docs for Axiom. Can this run on iOS?

[ Parent | on HN ]

Re:Parakeet.cpp – Parakeet ASR inference in pure C++ with Me... by noahkay13 on Friday February 27, 2026 @03:32AM (#47178082)

Theoretically, yes? This hasent been tested but xcode has great c++ interop and the goal with Axiom and now parakeet.cpp is to be used for portable deployments so making that process easier is definitely on the roadmap.

[ Parent | on HN ]

Re:Parakeet.cpp – Parakeet ASR inference in pure C++ with Me... by computerex on Friday February 27, 2026 @06:26AM (#47179263)

Oh hey I just implemented this in golang. Mine implementation heavily optimized for cpu.

[ Parent | on HN ]

Re:Parakeet.cpp – Parakeet ASR inference in pure C++ with Me... by pdyc on Friday February 27, 2026 @09:53AM (#47181164)

can you share your repo.

[ Parent | on HN ]