Also, the devices are used for entertainment, even if you did give a toddler a touchtone phone as a toy, you'd disconnect it from the line.
In any case, the phone won't actually dial the number even if you do type it in -- if you dial what it thinks is an emergency number, it initiates the emergency call setup, which is what lets you dial without a SIM and on a different providers' network. So a dedicated button is all that's required.
This does mean that there's a possibility that my phone and the PSTN disagree over what constitutes an emergency network, but as the phone gets its numbers from the SIM, which comes from my provider, which is regulated by the same people as make the rules for the PSTN, it seems likely that all the options will work.
I'm curious why this wasn't really a problem when we had landlines in our houses. Is it just because these devices are a lot more fun to play with than phones were and the kid eventually dials 911 accidentally?