current state-of-the-art recognizers in the cloud are probably done on CPU systems, so it could be done on-device. once they switch to TPUs than the consumer devices need to get a little chip as well to complete.