Crowdsourcing with diverse groups of users

Sara Cohen, Moran Yashinski

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

6 Scopus citations


When crowdsourcing to achieve some goal, or to gather information, there is a distinct advantage to choosing a diverse team of users. Past research has shown the advantages of diversity in the workplace, as team members bring different perspectives and points of view. Similarly, when choosing users from a crowd, user diversity must be taken into consideration. This paper studies the diverse team formation problem. More precisely, we are given a set of required skills, as wells as a large set of people, each of who has some subset of the skills. The goal is to form a team satisfying the skills, that is also diverse, as is reflected by differences in the characteristics of team members (e.g., gender, race, country of residence, economic bracket). We show that finding an optimal (diverse) team of people is an NP-complete problem. In practice, the number of candidates is likely to strongly dominate the number of skills and characteristics. Hence, we provide an algorithm that returns an optimal solution, while running in time that is indifferent to the number of candidates (but is exponential in the number of skills and characteristics). We also provide a polynomial method for approximating optimal team formation by a reduction to the problem of submodular function maximization with a matroid constraint. Extensive experimentation shows both scalability of our methods, and the quality of the solutions returned.

Original languageAmerican English
Title of host publication20th International Workshop on the Web and Databases, WebDB 2017 - Web of Opinions
Subtitle of host publicationTruths, Beliefs, and Confl
EditorsPierre Senellart, Alexandra Meliou
PublisherAssociation for Computing Machinery, Inc
Number of pages6
ISBN (Print)9781450349833
StatePublished - 14 May 2017
Event20th International Workshop on the Web and Databases, WebDB 2017 - Chicago, United States
Duration: 14 May 2017 → …

Publication series

Name20th International Workshop on the Web and Databases, WebDB 2017 - Web of Opinions: Truths, Beliefs, and Conficts


Conference20th International Workshop on the Web and Databases, WebDB 2017
Country/TerritoryUnited States
Period14/05/17 → …

Bibliographical note

Publisher Copyright:
© 2017 ACM.


Dive into the research topics of 'Crowdsourcing with diverse groups of users'. Together they form a unique fingerprint.

Cite this