If there are zillions of angels and all of them are equal, then sure it's probably a very hard market to corner. But from my view, there are hot startups and those startups want the very best angels. I would guess it follows a power law distribution. Startups want money, but they also want name brand money and the powerful connections that come with it.
These angels may miss a few deals here and there to the angels who aren't in on it, but I think they can move the terms in their favor.
I also think your analogy works better the other way around: even though there are almost 5000 US colleges to chose from - some of them extremely accessible - I think the top 10-20 schools could easily collude to extract better terms from students. This is because the name recognition is important.
Just because there are alternatives and they're still offering a better deal than everyone else doesn't mean that such market manipulation would be legal or fair.