A friend of mine is building a physical product based on the ESP32 platform that is exactly along those lines. I would be happy to put you in touch with him if it interests you, just email me pc.peterso AT (capital G’s mail service).com