Do you think the employer should be able to ask about your heritage then? Whether you have any grandparents of ethnicity X? How long ago did your ancestors arrive in the country?

>you can choose not to work for employers that ask the question in the first place

You can choose that, but not everyone can. That's the issue here, most people on HN never even encounter the problem, but they are definitely not the average employee.