I think that the open source nature of this project would help in that regard. Since there wouldn't be a specific set of hardware tied to it like with the Echo and other devices, you could make a rig that only begins listening upon being prompted to by a button.