The difference is the other students. For most, your peer group is what motivates you. A peer group which values excellence in X will motivate you to become excellent in X.

The peer group in the ivy leagues have been strongly pre-selected to value achievement in academic related pursuits.