I ride much slower on mixed use paths or around pedestrians, me hitting someone at 32km/h is going to hurt both of us potentially badly.
This makes no sense. You can pedal an electric bike at least as fast if not faster than a regular bike.
Some e-bikes are speed limited to cut out the assist at a certain speed, but it doesn't mean it also removes your ability to pedal hard and achieve the same speed.
Most Dutch cycle at about 25km/hour (whether or not electric) - those cyclists that easily do 30 on normal city bikes are probably the last generation that will switch to e-bikes.
There are many different types of e-bikes, and you're probably thinking of what are effective electric mopeds, with big batteries and engines and a throttle control. Those certainly go very fast. They're also not legal in many places, including here in NYC, and aren't necessarily what people mean when they're talking about e-bikes; that's usually referring to pedal-assist.
Proper road racing enthusiasts can average 35km/h including stops (the joys of a flat country).
It beats being lazy in a car and I'm very thankful that the infrastructure here in NL supports it.