Not at all. A large enough roundabout with good visibility from the approach can allow you to traverse it without slowing down at all - if the speed limits coming up to the yield line are appropriate, and traffic is flowing.
There's a sense in which a roundabout is just a short circular section of highway with a series of on and off-ramps around the edge. Well designed onramps allow you to merge without slowing, and off-ramps let you leave without disrupting traffic. Roundabouts can permit the same.
Since even a fender bender can cost many thousands of dollars in repairs that's still pretty terrible. Speed bumps slow drivers down too and don't risk people turning into you because they were trying to exit from the inside lane of a roundabout.
The two lanes are there in larger, busier roundabouts to reduce collisions, not for "slower traffic, keep right"; it's not a freeway. Cars enter the outer lane, and may use the inside lane to avoid other cars entering.
Two-lane roundabouts are larger; cars go around them faster. There is ambiguity. Some cars short-cut using the middle lane, and veer right out of it to their desired exit. Cars in the outer lane might be wrongly assumed to be turning off at the next exit. North American drivers get really confused by two-lane roundabouts.
I don't think these situations will typically lead to anything worse than fender benders.
The same intersection without a roundabout could be host to fatal collisions, when two vehicles enter at speed and hit each other in the middle.