Identifying a minimal class of models for high-dimensional data

Daniel Nevo, Ya'acov Ritov

Research output: Contribution to journalArticlepeer-review

7 Scopus citations

Abstract

Model selection consistency in the high{dimensional regression setting can be achieved only if strong assumptions are fulfilled. We therefore suggest to pursue a difierent goal, which we call a minimal class of models. The minimal class of models includes models that are similar in their prediction accuracy but not necessarily in their elements. We suggest a random search algorithm to reveal candidate models. The algorithm implements simulated annealing while using a score for each predictor that we suggest to derive using a combination of the lasso and the elastic net. The utility of using a minimal class of models is demonstrated in the analysis of two data sets.

Original languageEnglish
JournalJournal of Machine Learning Research
Volume18
StatePublished - 1 Apr 2017

Bibliographical note

Publisher Copyright:
© 2017 Daniel Nevo and Ya'acov Ritov.

Keywords

  • Elastic net
  • High{dimensional data
  • Lasso
  • Model selection
  • Simulated annealing

Fingerprint

Dive into the research topics of 'Identifying a minimal class of models for high-dimensional data'. Together they form a unique fingerprint.

Cite this