Usually name, accent, dialect, food habits. It's not visible upfront, but a few minutes of conversation will get that information.

There is a skin colour bias, but that isn't about caste (darker skin is a sign that you have to work in the sun, which signals poverty and being of a lower economic class).