Ballpark learning: Estimating labels from rough group comparisons

Tom Hope*, Dafna Shahaf

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Scopus citations

Abstract

We are interested in estimating individual labels given only coarse, aggregated signal over the data points. In our setting, we receive sets (“bags”) of unlabeled instances with constraints on label proportions. We relax the unrealistic assumption of known label proportions, made in previous work; instead, we assume only to have upper and lower bounds, and constraints on bag differences. We motivate the problem, propose an intuitive formulation and algorithm, and apply our methods to real world scenarios. Across several domains, we show how using only proportion constraints and no labeled examples, we can achieve surprisingly high accuracy. In particular, we demonstrate how to predict income level using rough stereotypes and how to perform sentiment analysis using very little information. We also apply our method to guide exploratory analysis, recovering geographical differences in twitter dialect.

Original languageAmerican English
Title of host publicationMachine Learning and Knowledge Discovery in Databases - European Conference, ECML PKDD 2016, Proceedings
EditorsNiels Landwehr, Jilles Giuseppe, Giuseppe Manco, Paolo Frasconi
PublisherSpringer Verlag
Pages299-314
Number of pages16
ISBN (Print)9783319462264
DOIs
StatePublished - 2016
Event15th European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2016 - Riva del Garda, Italy
Duration: 19 Sep 201623 Sep 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9852 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference15th European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2016
Country/TerritoryItaly
CityRiva del Garda
Period19/09/1623/09/16

Bibliographical note

Publisher Copyright:
© Springer International Publishing AG 2016.

Fingerprint

Dive into the research topics of 'Ballpark learning: Estimating labels from rough group comparisons'. Together they form a unique fingerprint.

Cite this