Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX

Re:Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX by SlavikCA on Wednesday December 13, 2023 @11:03AM (#38629347)

It's easy to run Whisper on my Mac M1. But it's not using MLX out of the box.

I spend an hour or two, trying to run figure out what I need to install / configure to enable it to use MLX. Was getting cryptic Python errors, Torch errors... Gave up on it.

I rented VM with GPU, and started Whisper on it within few minutes.

[ Parent | on HN ]

Re:Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX by JCharante on Wednesday December 13, 2023 @12:22PM (#38630643)

Hmm, I've been using this product for whisper https://betterdictation.com/

[ Parent | on HN ]

Re:Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX by xd1936 on Wednesday December 13, 2023 @11:43AM (#38629956)

I've really enjoyed this macOS Whisper GUI[1]. It doesn't use MLX, but does use Metal.

1. https://goodsnooze.gumroad.com/l/macwhisper

[ Parent | on HN ]

Re:Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX by tambourine_man on Wednesday December 13, 2023 @11:44AM (#38629964)

Is was released last week. Give it a month or two

[ Parent | on HN ]

Re:Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX by jonnyreiss on Wednesday December 13, 2023 @03:22PM (#38633652)

I was able to get it running on MLX on my M2 Max machine within a couple minutes using their example: https://github.com/ml-explore/mlx-examples/tree/main/whisper

[ Parent | on HN ]