Wisdom of the crowd in egocentric video curation

Yedid Hoshen; Gil Ben-Artzi; Shmuel Peleg

doi:10.1109/CVPRW.2014.90

Wisdom of the crowd in egocentric video curation

Yedid Hoshen^*, Gil Ben-Artzi, Shmuel Peleg

^*Corresponding author for this work

The Rachel and Selim Benin School of Engineering and Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

17 Scopus citations

Abstract

Videos recorded by wearable egocentric cameras can suffer from quality degradations that cannot always be fixed by current methods. When several wearable video cameras are viewing the same scene, each having highly variable quality, it is possible to combine them into a single high-quality video. Current techniques select for each point in time the highest quality video stream, but the highest quality video may not be relevant. E.g. the best quality video can come from a person that happen to look sideways from the main attraction. We propose the curation of a single video stream from multiple egocentric videos by requiring that the selected video will also view the most interesting region in the scene. Importance of a region is determined by the 'wisdom of the crowd', i.e. the number of cameras looking at a region. The resulting video is more interesting and of higher quality than any individual video streams can possibly obtain. Several examples are presented demonstrating the effectiveness of this technique.

Original language	English
Title of host publication	Proceedings - 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2014
Publisher	IEEE Computer Society
Pages	587-593
Number of pages	7
ISBN (Electronic)	9781479943098, 9781479943098
DOIs	https://doi.org/10.1109/CVPRW.2014.90
State	Published - 24 Sep 2014
Event	2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2014 - Columbus, United States Duration: 23 Jun 2014 → 28 Jun 2014

Publication series

Name	IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
ISSN (Print)	2160-7508
ISSN (Electronic)	2160-7516

Conference

Conference	2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2014
Country/Territory	United States
City	Columbus
Period	23/06/14 → 28/06/14

Bibliographical note

Publisher Copyright:
© 2014 IEEE.

Keywords

Egocentric Video
Frame Popularity
Multi-Video Editing
Video Curation
Video Stabilization
Video Stream Selection
Video Summarization

Access to Document

10.1109/CVPRW.2014.90

Cite this

Hoshen, Y., Ben-Artzi, G., & Peleg, S. (2014). Wisdom of the crowd in egocentric video curation. In Proceedings - 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2014 (pp. 587-593). Article 6910039 (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops). IEEE Computer Society. https://doi.org/10.1109/CVPRW.2014.90

@inproceedings{9a2de13eb99b470fa02ac98dbce1b437,

title = "Wisdom of the crowd in egocentric video curation",

abstract = "Videos recorded by wearable egocentric cameras can suffer from quality degradations that cannot always be fixed by current methods. When several wearable video cameras are viewing the same scene, each having highly variable quality, it is possible to combine them into a single high-quality video. Current techniques select for each point in time the highest quality video stream, but the highest quality video may not be relevant. E.g. the best quality video can come from a person that happen to look sideways from the main attraction. We propose the curation of a single video stream from multiple egocentric videos by requiring that the selected video will also view the most interesting region in the scene. Importance of a region is determined by the 'wisdom of the crowd', i.e. the number of cameras looking at a region. The resulting video is more interesting and of higher quality than any individual video streams can possibly obtain. Several examples are presented demonstrating the effectiveness of this technique.",

keywords = "Egocentric Video, Frame Popularity, Multi-Video Editing, Video Curation, Video Stabilization, Video Stream Selection, Video Summarization",

author = "Yedid Hoshen and Gil Ben-Artzi and Shmuel Peleg",

note = "Publisher Copyright: {\textcopyright} 2014 IEEE.; 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2014 ; Conference date: 23-06-2014 Through 28-06-2014",

year = "2014",

month = sep,

day = "24",

doi = "10.1109/CVPRW.2014.90",

language = "אנגלית",

series = "IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops",

publisher = "IEEE Computer Society",

pages = "587--593",

booktitle = "Proceedings - 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2014",

address = "ארצות הברית",

}

Hoshen, Y, Ben-Artzi, G & Peleg, S 2014, Wisdom of the crowd in egocentric video curation. in Proceedings - 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2014., 6910039, IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, IEEE Computer Society, pp. 587-593, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2014, Columbus, United States, 23/06/14. https://doi.org/10.1109/CVPRW.2014.90

Wisdom of the crowd in egocentric video curation. / Hoshen, Yedid; Ben-Artzi, Gil; Peleg, Shmuel.
Proceedings - 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2014. IEEE Computer Society, 2014. p. 587-593 6910039 (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Wisdom of the crowd in egocentric video curation

AU - Hoshen, Yedid

AU - Ben-Artzi, Gil

AU - Peleg, Shmuel

PY - 2014/9/24

Y1 - 2014/9/24

N2 - Videos recorded by wearable egocentric cameras can suffer from quality degradations that cannot always be fixed by current methods. When several wearable video cameras are viewing the same scene, each having highly variable quality, it is possible to combine them into a single high-quality video. Current techniques select for each point in time the highest quality video stream, but the highest quality video may not be relevant. E.g. the best quality video can come from a person that happen to look sideways from the main attraction. We propose the curation of a single video stream from multiple egocentric videos by requiring that the selected video will also view the most interesting region in the scene. Importance of a region is determined by the 'wisdom of the crowd', i.e. the number of cameras looking at a region. The resulting video is more interesting and of higher quality than any individual video streams can possibly obtain. Several examples are presented demonstrating the effectiveness of this technique.

AB - Videos recorded by wearable egocentric cameras can suffer from quality degradations that cannot always be fixed by current methods. When several wearable video cameras are viewing the same scene, each having highly variable quality, it is possible to combine them into a single high-quality video. Current techniques select for each point in time the highest quality video stream, but the highest quality video may not be relevant. E.g. the best quality video can come from a person that happen to look sideways from the main attraction. We propose the curation of a single video stream from multiple egocentric videos by requiring that the selected video will also view the most interesting region in the scene. Importance of a region is determined by the 'wisdom of the crowd', i.e. the number of cameras looking at a region. The resulting video is more interesting and of higher quality than any individual video streams can possibly obtain. Several examples are presented demonstrating the effectiveness of this technique.

KW - Egocentric Video

KW - Frame Popularity

KW - Multi-Video Editing

KW - Video Curation

KW - Video Stabilization

KW - Video Stream Selection

KW - Video Summarization

UR - http://www.scopus.com/inward/record.url?scp=84908508592&partnerID=8YFLogxK

U2 - 10.1109/CVPRW.2014.90

DO - 10.1109/CVPRW.2014.90

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:84908508592

T3 - IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

SP - 587

EP - 593

BT - Proceedings - 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2014

PB - IEEE Computer Society

T2 - 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2014

Y2 - 23 June 2014 through 28 June 2014

ER -

Wisdom of the crowd in egocentric video curation

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this