>Honestly, I don't get why /r/all even exists,

I'd venture to guess /r/all exists for the same reason the Facebook News Feed exists: to increase engagement with the site. It's a curation mechanism that amplifies the already popular items within the sub communities, and exposes them to the community at large in a virtuous (vicious?) cycle.