It's the "caste" system, not the "cast" system. Your friend does seem to have a pretty conservative circle of movement. He's probably talking about arranged marriages, not "dates".

(Am Indian, have gone on plenty of dates without ever meeting anyone's father.)