A computer vision system for on-screen item selection by finger pointing

M. S. Lee*, D. Weinshall, E. Cohen-Solal, A. Colmenarez, D. Lyons

*Corresponding author for this work

Research output: Contribution to journalConference articlepeer-review

13 Scopus citations

Abstract

Pointing at planar surfaces such as TV and computer monitors or projection screens can be a useful mode of interaction between humans and machines. To a large extent what seems to hinder the use of vision in such practical applications is the difficulty of the computational task, which is typically defined as 3-D reconstruction from uncalibrated 2-D images of a non-static scene. We describe below two designs where, using one or two cameras, the target of pointing on a flat monitor or screen is identified without 3-D inference, using only image morphing and line intersection. This is accomplished by registering the images with the target plane. When used to identify a pointing target on a surface hiden from the camera (e.g., a computer monitor which supports the camera itself as in most PC configurations), we add aperture(s) coplanar with the target surface in front of the camera(s). We describe experimental results showing a fully automated procedure for pointing target detection with high accuracy. The simplicity of our method and its robustness, as well as the relative accuracy of our results, can make pointing a practical means of human-machine interaction.

Original languageAmerican English
Pages (from-to)I1026-I1033
JournalProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Volume1
StatePublished - 2001
Externally publishedYes
Event2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Kauai, HI, United States
Duration: 8 Dec 200114 Dec 2001

Fingerprint

Dive into the research topics of 'A computer vision system for on-screen item selection by finger pointing'. Together they form a unique fingerprint.

Cite this