Mosaicing with parallax using time warping

Alex Rav-Acha, Yael Shor, Shmuel Peleg

Research output: Contribution to journalConference articlepeer-review

15 Scopus citations

Abstract

2D image alignment methods are applied successfully for mosaicing aerial images, but fail when the camera moves in a 3D scene. Such methods can not handle 3D parallax, resulting in distorted mosaicing. General egomotion methods are slow, and do not have the robustness of 2D alignment methods. We propose to use the x-y-t space-time volume as a tool for depth invariant mosaicing. When the camera moves on a straight line in the x direction, a y-t slice of the space-time volume is a panoramic mosaic, while a x-t slice is an EPI plane. Time warping, which is a resampling of the t axix, is used to form straight feature lines in the EPI planes. This process will simultaneously give best panoramic mosaic in the y-t slices. This approach is as robust as 2D alignment methods, while giving depth invariant motion ("ego motion"). Extensions for two dimensional camera motion on a plane are also described, with applications for 2D mosaicing, and for image based rendering such as "light field".

Original languageEnglish
Article number1384963
JournalIEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
Volume2004-January
Issue numberJanuary
DOIs
StatePublished - 2004
Event2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2004 - Washington, United States
Duration: 27 Jun 20042 Jul 2004

Bibliographical note

Publisher Copyright:
© 2004 IEEE.

Fingerprint

Dive into the research topics of 'Mosaicing with parallax using time warping'. Together they form a unique fingerprint.

Cite this