News for hackers. Stuff that matters.
Re:Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX by isodev on Wednesday December 13, 2023 @11:54AM (#38630149)
It also wasn’t optimised for Apple Silicon. Given how the different platforms performed in this test, the conclusions seem pretty solid.
Re:Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX by jbellis on Wednesday December 13, 2023 @12:00PM (#38630253)
He is literally comparing whisper.cpp on the 4090 with an optimized-for-apple-silicon-by-apple-engineers version on the M1.

ETA: actually it's unclear from the article if the whisper optimizations were done by apple engineers, but it's definitely an optimized version.

Re:Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX by isodev on Wednesday December 13, 2023 @12:14PM (#38630498)
Maybe I’m not seeing it right, but the comparing the source of Apple’s Whisper to Python Whisper seems there are minimal changes to redirect certain operations to using MLX.

There is also cpp Whisper (https://github.com/ggerganov/whisper.cpp) which seems to have it’s own kind of optimizations for Apple Silicon - I don’t think this was the one used with Nvidia during the test.

Re:Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX by rowanG077 on Wednesday December 13, 2023 @12:09PM (#38630412)
I don't think whisper was optimized for apple silicon. Doesn't it just use MLX? I mean if using an API for a platform counts as specifically optimized then the Nvidia version is "optimized" as well since it's probably using CUDA.