Motion segmentation and depth ordering using an occlusion detector

Doron Feldman*, Daphna Weinshall

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

27 Scopus citations

Abstract

We present a novel method for motion segmentation and depth ordering from a video sequence in general motion. We first compute motion segmentation based on differential properties of the spatio-temporal domain, and scale-space integration. Given a motion boundary, we describe two algorithms to determine depth ordering from two- and three- frame sequences. An remarkable characteristic of our method is its ability compute depth ordering from only two frames. The segmentation and depth ordering algorithms are shown to give good results on 6 real sequences taken in general motion. We use synthetic data to show robustness to high levels of noise and illumination changes; we also include cases where no intensity edge exists at the location of the motion boundary, or when no parametric motion model can describe the data. Finally, we describe human experiments showing that people, like our algorithm, can compute depth ordering from only two frames, even when the boundary between the layers is not visible in a single frame.

Original languageAmerican English
Pages (from-to)1171-1185
Number of pages15
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume30
Issue number7
DOIs
StatePublished - Jul 2008

Bibliographical note

Funding Information:
This research was supported by the European Union (EU) under the Detection and Identification of Rare Audiovisual Cues (DIRAC) Integrated Project IST-027787.

Keywords

  • Depth cues
  • Image processing and computer vision
  • Motion
  • Segmentation
  • Video analysis

Fingerprint

Dive into the research topics of 'Motion segmentation and depth ordering using an occlusion detector'. Together they form a unique fingerprint.

Cite this