From reference frames to reference planes: Multi-view parallax geometry and applications

M. Irani, P. Anandan, D. Weinshall

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

41 Scopus citations

Abstract

This paper presents a new framework for analyzing the geometry of multiple 3D scene points from multiple uncalibrated images, based on decomposing the projection of these points on the images into two stages: (i) the projection of the scene points onto a (real or virtual) physical reference planar surface in the scene; this creates a virtual "image" on the reference plane, and (ii) the re-projection of the virtual image onto the actual image plane of the camera. The positions of the virtual image points are directly related to the 3D locations of the scene points and the camera centers relative to the reference plane alone. All dependency on the internal camera calibration parameters and the orientation of the camera are folded into homographies relating each image plane to the reference plane. Bi-linear and tri-linear constraints involving multiple points and views are given a concrete physical interpretation in terms of geometric relations on the physical reference plane. In particular, the possible dualities in the relations between scene points and camera centers are shown to have simple and symmetric mathematical forms. In contrast to the plane+parallax (p+p) representation, which also uses a reference plane, the approach described here removes the dependency on a reference image plane and extends the analysis to multiple views. This leads to simpler geometric relations and complete symmetry in multi-point multiview duality. The simple and intuitive expressions derived in the reference-plane based formulation lead to useful applications in 3D scene analysis. In particular, simpler tri-focal constraints are derived that lead to simple methods for New View Synthesis. Moreover, the separation and compact packing of the unknown camera calibration and orientation into the 2D projection transformation (a homography) allows also partial reconstruction using partial calibration information.

Original languageAmerican English
Title of host publicationComputer Vision - ECCV 1998 - 5th European Conference on Computer Vision, Proceedings
EditorsBernd Neumann, Hans Burkhardt
PublisherSpringer Verlag
Pages829-845
Number of pages17
ISBN (Print)3540646132, 9783540646136
DOIs
StatePublished - 1998
Event5th European Conference on Computer Vision, ECCV 1998 - Freiburg, Germany
Duration: 2 Jun 19986 Jun 1998

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume1407
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference5th European Conference on Computer Vision, ECCV 1998
Country/TerritoryGermany
CityFreiburg
Period2/06/986/06/98

Bibliographical note

Publisher Copyright:
© Springer-Verlag Berlin Heidelberg 1998.

Keywords

  • Duality of cameras and scene points
  • Multi-point multi-view geometry
  • New view synthesis
  • Plane+parallax
  • Trilinearity
  • Uncalibrated images

Fingerprint

Dive into the research topics of 'From reference frames to reference planes: Multi-view parallax geometry and applications'. Together they form a unique fingerprint.

Cite this