Also year-round commuter in Norway w/ an e-bike. I agree that the increased speed increases the probability of an accident. I've personally had several close calls vs cars in roundabouts and on bike lanes (!).
I also have a motorcycle license and I've been riding motorcycles for about 5 years in traffic. A lot of the risks are very similar to the ones you experience on an e-bike in my opinion.
Edit: The best tip I can give to two-wheel riders is to increase visibility as much as possible, and be observant of cars. Lights and bright colored clothing helps a lot.
My commute is mostly on roads with cars. I don't ride as fast as I can. Driving defensively, you want to be able to break and avoid a collision.
I witnessed a really bad accident, where a car t-boned a cyclist. This has cured me of riding as fast as I can into work.
I see a lot of normal bikers as well as e-bikers going faster than is safe and I think e-bikes contribute to riders putting themselves into jeopardy.