I'm curious why this wasn't really a problem when we had landlines in our houses. Is it just because these devices are a lot more fun to play with than phones were and the kid eventually dials 911 accidentally?
Also, the devices are used for entertainment, even if you did give a toddler a touchtone phone as a toy, you'd disconnect it from the line.
In any case, the phone won't actually dial the number even if you do type it in -- if you dial what it thinks is an emergency number, it initiates the emergency call setup, which is what lets you dial without a SIM and on a different providers' network. So a dedicated button is all that's required.
This does mean that there's a possibility that my phone and the PSTN disagree over what constitutes an emergency network, but as the phone gets its numbers from the SIM, which comes from my provider, which is regulated by the same people as make the rules for the PSTN, it seems likely that all the options will work.
On the other hand, they can use the AppleTV remote quite easily without much worry. So, the lack of a viable (dedicated) remote for the Chromecast is an issue for some.
For us, I have an AppleTV in the living room that the kids can use, but a Chromecast in the bedroom that only my wife and I use. Although, I have had a problem before where my 3 year old figured out how to tell Netflix on an iPad to play a movie to our Chromecast. She had no idea why her movie wouldn't play and got very frustrated!