Agglomerative multivariate information bottleneck

Noam Slonim, Nir Friedman, Naftali Tishby

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

7 Scopus citations

Abstract

The information bottleneck method is an unsupervised model independent data organization technique. Given a joint distribution P(A,B), this method constructs a new variable T that extracts partitions, or clusters, over the values of ,4 that are informative about B. In a recent paper, we introduced a general principled framework for multivariate extensions of the information bottleneck method that allows us to consider multiple systems of data partitions that are inter-related. In this paper, we present a new family of simple agglomerative algorithms to construct such systems of inter-related clusters. We analyze the behavior of these algorithms and apply them to several real-life datasets.

Original languageAmerican English
Title of host publicationAdvances in Neural Information Processing Systems 14 - Proceedings of the 2001 Conference, NIPS 2001
PublisherNeural information processing systems foundation
ISBN (Print)0262042088, 9780262042086
StatePublished - 2002
Event15th Annual Neural Information Processing Systems Conference, NIPS 2001 - Vancouver, BC, Canada
Duration: 3 Dec 20018 Dec 2001

Publication series

NameAdvances in Neural Information Processing Systems
ISSN (Print)1049-5258

Conference

Conference15th Annual Neural Information Processing Systems Conference, NIPS 2001
Country/TerritoryCanada
CityVancouver, BC
Period3/12/018/12/01

Fingerprint

Dive into the research topics of 'Agglomerative multivariate information bottleneck'. Together they form a unique fingerprint.

Cite this