I agree that they're not totally arbitrary and there is probably some correlation between broad peer review acceptance of the genius of some work and a Nobel prize. However, there are also plenty of other committees which could award prizes but which don't carry the same prestige for seemingly arbitrary reasons: e.g. the Royal Society.