This seems like just background subtraction. I used this on soccer videos eight years ago using some robust optical flow code from Michael Black to estimate the background motion and suppress it, leaving the foreground (i.e. the player).