I don't think the sentiment was "die racists die!", but rather, "well, those backwards thinking assholes from the pre-60s are dying off anyway -- might as well wait em out".