Slippage-free background replacement for hand-held video

Fan Zhong*, Song Yang, Xueying Qin, Dani Lischinski, Daniel Cohen-Or, Baoquan Chen

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

7 Scopus citations


(Figure Presented) We introduce a method for replacing the background in a video of a moving foreground subject, when both the source video capturing the subject, and the target video capturing the new background scene, are natural videos, casually captured using a freely moving hand-held camera. We assume that the foreground subject has already been extracted, and focus on the challenging task of generating a video with a new background, such that the new background motion appears compatible with the original one. Failure to match the motion results in disturbing slippage or moonwalk artifacts, where the subject's feet appear to slide or slip over the ground. While matching the motion across the entire frame is impossible for scenes with differing geometry, we aim to match the local motion of the ground in the vicinity of the subject. This is achieved by reordering and warping the available target background frames in a manner that optimizes a suitably designed objective function.

Original languageAmerican English
JournalACM Transactions on Graphics
Issue number6
StatePublished - 19 Nov 2014

Bibliographical note

Publisher Copyright:
Copyright © ACM.


  • Background replacement
  • Compositing
  • Homography
  • Motion analysis
  • Slippage


Dive into the research topics of 'Slippage-free background replacement for hand-held video'. Together they form a unique fingerprint.

Cite this