I'd say that universities did contain only highly interested intellectuals. But they contained just a small subset of all highly interested intellectuals: those who had been able to go to university and pursue a doctorate. It's much easier to do this now - for example, if you are a woman. On the other hand, there are probably more networkers and grifters too.
Which time period, and where? Universities used to be more exclusive, but I somehow doubt that exclusivity was for "intellectuals trained to handle that diversity" and not just "well-connected people".