I studied this in college. The 8 point algorithm as I recall
<a href="https://en.wikipedia.org/wiki/Eight-point_algorithm" rel="nofollow">https://en.wikipedia.org/wiki/Eight-point_algorithm</a><p>A sample project I did at UCLA
<a href="https://drive.google.com/file/d/0B2cbJSismcJbVk02MXd1b2pnU3c/view?usp=sharing" rel="nofollow">https://drive.google.com/file/d/0B2cbJSismcJbVk02MXd1b2pnU3c...</a>
The impainting can be global and locally, but it has to be temporally stable to avoid shakiness associated with impainting multiple frames.<p>Photoshop unveiled a similar temporally stable algorithm which does just that (provided that you select a marquee selection around the object.) I can't find the link though. Perhaps those two algorithms can be combined to first locate the object then remove it.