It's often also very local. Everyone knows who some castes are like Patels and Nayars, but how many people in north india know that vellalars are relatively high caste (but not brahman) for instance. And of course the specific relationship between various castes can change village to village.