Depends on your point of view. It's certainly not synonymous with whites. It originates as a slur against rural people and retains some of that sense -- you wouldn't talk about "Seattle rednecks". But you could interpret it as an ethnic slur against certain specific groups that are white, e.g. Appalachians.