The main opposition is from the Hindu American Foundation, which has strong links to the Hindutva party governing India, (the BJP), which is affiliated to RSS, the extremist paramilitary Hindutva organization. You can probably understand why Hindu supremacist organizations would want to downplay or deny the negative effects of caste.