If there are zillions of angels and all of them are equal, then sure it's probably a very hard market to corner. But from my view, there are hot startups and those startups want the very best angels. I would guess it follows a power law distribution. Startups want money, but they also want name brand money and the powerful connections that come with it.
These angels may miss a few deals here and there to the angels who aren't in on it, but I think they can move the terms in their favor.
I also think your analogy works better the other way around: even though there are almost 5000 US colleges to chose from - some of them extremely accessible - I think the top 10-20 schools could easily collude to extract better terms from students. This is because the name recognition is important.
Just because there are alternatives and they're still offering a better deal than everyone else doesn't mean that such market manipulation would be legal or fair.
If this is true then there is even more reason to believe that the Bin38 meeting was meant to inject some collusion.