Outliers aside, a big difference between skateboards and cars is the kind of sound a skateboard makes. It's typically a lot less uniform just rolling on the pavement, with "random" sharp sounds if they're doing tricks or similar.

For me at least this is a lot more annoying or stressful than a loud but uniform sound, even if it's louder than the skateboard.