Non-Rigid Dense Correspondence with Applications for Image Enhancement

Yoav HaCohen, Dani Lischinski, Eli Shechtman, Dan B. Goldman

Research output: Contribution to journalArticlepeer-review

42 Scopus citations

Abstract

This paper presents a new efficient method for recovering reliable local sets of dense correspondences between two images with some shared content. Our method is designed for pairs of images depicting similar regions acquired by different cameras and lenses, under non-rigid transformations, under different lighting, and over different backgrounds. We utilize a new coarse-to-fine scheme in which nearest-neighbor field computations using Generalized PatchMatch [Barnes et al. 2010] are interleaved with fitting a global non-linear parametric color model and aggregating consistent matching regions using locally adaptive constraints. Compared to previous correspondence approaches, our method combines the best of two worlds: It is dense, like optical flow and stereo reconstruction methods, and it is also robust to geometric and photometric variations, like sparse feature matching. We demonstrate the usefulness of our method using three applications for automatic example-based photograph enhancement: adjusting the tonal characteristics of a source image to match a reference, transferring a known mask to a new image, and kernel estimation for image deblurring.

Original languageAmerican English
Pages (from-to)1-10
Number of pages10
JournalACM Transactions on Graphics
Volume30
Issue number4
DOIs
StatePublished - 1 Jul 2011

Keywords

  • PatchMatch
  • color transfer
  • correspondence
  • deblurring
  • nearest neighbor field

Fingerprint

Dive into the research topics of 'Non-Rigid Dense Correspondence with Applications for Image Enhancement'. Together they form a unique fingerprint.

Cite this