Data-driven enhancement of facial attractiveness

Tommer Leyvand*, Daniel Cohen-Or, Gideon Dror, Dani Lischinski

*Corresponding author for this work

Research output: Contribution to conferencePaperpeer-review

59 Scopus citations

Abstract

When human raters are presented with a collection of shapes and asked to rank them according to their aesthetic appeal, the results often indicate that there is a statistical consensus among the raters. Yet it might be difficult to define a succinct set of rules that capture the aesthetic preferences of the raters. In this work, we explore a data-driven approach to aesthetic enhancement of such shapes. Specifically, we focus on the challenging problem of enhancing the aesthetic appeal (or the attractiveness) of human faces in frontal photographs (portraits), while maintaining close similarity with the original. The key component in our approach is an automatic facial attractiveness engine trained on datasets of faces with accompanying facial attractiveness ratings collected from groups of human raters. Given a new face, we extract a set of distances between a variety of facial feature locations, which define a point in a high-dimensional "face space". We then search the face space for a nearby point with a higher predicted attractiveness rating. Once such a point is found, the corresponding facial distances are embedded in the plane and serve as a target to define a 2D warp field which maps the original facial features to their adjusted locations. The effectiveness of our technique was experimentally validated by independent rating experiments, which indicate that it is indeed capable of increasing the facial attractiveness of most portraits that we have experimented with.

Original languageAmerican English
StatePublished - 2008
EventACM SIGGRAPH 2008 Papers 2008, SIGGRAPH'08 - Los Angeles, CA, United States
Duration: 11 Aug 200815 Aug 2008

Conference

ConferenceACM SIGGRAPH 2008 Papers 2008, SIGGRAPH'08
Country/TerritoryUnited States
CityLos Angeles, CA
Period11/08/0815/08/08

Keywords

  • Facial attractiveness
  • Machine learning
  • Optimization
  • Warping

Fingerprint

Dive into the research topics of 'Data-driven enhancement of facial attractiveness'. Together they form a unique fingerprint.

Cite this