I couldn't have explained it better. You've nailed the core issue - Reliability & Robustness. These attributes of a product disappear in the background when it just works.

Voice activated devices, even Google assistant, are far away from the reliability/robustness we expect from a reliable tool. Therefore, they are not tools yet.