I'll cancel your anecdote with mine.

I didn't take any advance math in HS and actually did quite average. By some miracle I was admitted a very good Electrical Engineering program. However they made me take these advance math classes before university to prove that I could handle the task.

Removing these options from HS just lowers the bar for everyone.