I don't think it is true that referee calls in soccer are more consequential than in e.g. rugby. In fact I would argue that in rugby a referee could make very subtle calls (that would likely not be picked up by many fans even) that can very substantially change a game, e.g. just how he referees the breakdown or scrums. Let's not even talk about giving or not giving a try etc..