This may be true in the kind of upper-middle class bubble where people discreetly brag about going to Yale, but if you stop random people on the street and ask them to free-associate about MIT most of the time you won't get anything except some vague understanding that nerds go there, although now the Big Bang Theory may have shifted that kind of common cultural cachet to Caltech.