However, I'd draw the comparison between a large crowd of rugby supporters leaving a match and a similar sized crowd of football supporters. I used to live near the Easter Road football ground in Edinburgh and that was pretty unpleasant and threatening on match days (particularly when Glasgow Rangers were playing...). I've never encountered the same level of sheer nastiness from a rugby crowd (and Edinburgh gets a lot of them) as from football crowd.
I remember once getting the last train from Glasgow to Edinburgh the day of an Old Firm match - one set of supporters at one end of the carriage, the other set of supporters at the other end and a few of us non-combatants sitting in the middle desperately trying to pretend that nothing was happening. That was fun.
NB Scotland does have a weird sectarian angle to football which doesn't help - although I don't think this is nearly as bad as it used to be.
I was thinking more about the actual players. It's also not a real statistic, just public perception: that Rugby players are spoiled rich kids prone to beating up other kids if they don't like the color of their skin.
In Argentina at least, football is linked to the people, low and upper class; it's a "popular" sport. In contrast, Rugby is linked to the elite; mostly well to do spoiled kids (in the public perception, at least). There were a couple of beatings/murders linked to spoiled rich kids who were Rugby players, enough that in our public perception today a Rugby player is definitely not considered a "gentleman" but a rich brat potentially prone to violence.