Lightning Whisper MLX

Re:Lightning Whisper MLX by mustafaaljadery on Tuesday April 02, 2024 @12:24PM (#39907568)

An extremely fast implementation of whisper built on top of Apple MLX. It outperforms Whisper CPP by ~10x.

[ Parent | on HN ]

Re:Lightning Whisper MLX by jxy on Tuesday April 02, 2024 @04:53PM (#39910762)

How did you run whisper.cpp? Can you share the command line? What machine did you use to run that benchmark figure?

[ Parent | on HN ]

Re:Lightning Whisper MLX by asdlkj178 on Tuesday April 02, 2024 @11:40PM (#39913386)

Will disable beam search hurt performance on long form transcription?

According to the whisper paper, beam search is necessary to achieve good long form audio transcription performance.

[ Parent | on HN ]