Seems like you have to do at least minimal analysis of all sounds to be listening for a hot word.