The biggest challenge is the voice recognition. There are a variety of open source projects. The Mozilla one is likely the most promising option at the moment. Kaldi and Sphinx are a couple of others. It's probably fair to say that nothing in the space is a "product" at the moment and would likely require a full PC to run as well.

I played around a bit to see if I could put together a standalone timer but didn't get very far.