Something is definitely wrong with your setup. You should not experience any noticeable tracking errors on current hardware.

Some combination of a bug, strange setup, or bad environment is going on here. Maybe you have a large mirror or pane of glass around your setup? Lots of things can go wrong.