Re:Universal Speech Model
by inciampati on Thursday March 30, 2023 @04:43AM
(#35369786)
That's very similar to CPU-based performance with modern CPUs and parallelization! Frankly, with whisper.cpp it tends to be a little faster than the length of the audio for the "small" model, and much faster for "base" and "tiny".
[ Parent
| on HN ]
Re:Universal Speech Model
by pantalaimon on Thursday March 30, 2023 @03:18PM
(#35377623)
Doesn't even have to be that modern, my Ivy Bridge CPU already achieves faster than realtime performance - which makes me wonder if there is maybe some upstart cost for the GPU based solution and it would outperform the CPU only with longer clips.