Re:AI PCs Aren't Good at AI: The CPU Beats the NPU
by Dylan16807 on Wednesday October 16, 2024 @06:03PM
(#41864298)
> I doubt these things can come even close to running whisper for decent voice transcription.
Whisper runs almost realtime on a single core of my very old CPU. I'd be very surprised if it can't fit in an NPU.
Re:AI PCs Aren't Good at AI: The CPU Beats the NPU
by kalleboo on Thursday October 17, 2024 @12:16AM
(#41866381)
> I doubt these things can come even close to running whisper for decent voice transcription
https://github.com/ggerganov/whisper.cpp/pull/566
"The performance gain is more than x3 compared to 8-thread CPU"
Eye contact filters seem like a horrible thing, autocorrect won't work better than a dictionary with a tiny model and I doubt these things can come even close to running whisper for decent voice transcription. Background blur alright, but that's kind of stretching it. I always figured Zoom/Teams do these things serverside anyway.
And alright, if it's not MS making them do it, then they're just chasing the fad themselves while also shipping subpar hardware. Not sure if that makes it better.