Re:Nvidia Nemotron 3.5 Transcribe: open ASR for 40 languages
by Farmadupe2 on Thursday October 29, 2026 @10:13AM
(#50289421)
Yes if parakeet would work then thats the answer and the code has already been written.
Otherwise the answer is really mechanical. It's will run as fast as you can get the weights into your cou's ALUs. since it's 30b-a4b, if you have 30G spare ram you can load the whole thing and it will run about as "fast" as any 4b model (qwen3.5-4b, gemma4 e4b etc).
Otherwise you will be streaming from disk/SSD which may or may not be very slow.
Otherwise the answer is really mechanical. It's will run as fast as you can get the weights into your cou's ALUs. since it's 30b-a4b, if you have 30G spare ram you can load the whole thing and it will run about as "fast" as any 4b model (qwen3.5-4b, gemma4 e4b etc).
Otherwise you will be streaming from disk/SSD which may or may not be very slow.