Yea, whisper runs fairly quickly on really old GPUs and leveraging CTranslate2 (underlying tech in your link) you need < 4GB of GPU RAM to run the large model.

This might be faster but an order of magnitude more expensive? Also, huge lockin to one provider.