The impainting can be global and locally, but it has to be temporally stable to avoid shakiness associated with impainting multiple frames.

Photoshop unveiled a similar temporally stable algorithm which does just that (provided that you select a marquee selection around the object.) I can't find the link though. Perhaps those two algorithms can be combined to first locate the object then remove it.