Simultaneous analysis of lasso and dantzig selector

Peter J. Bickel; Ya'acov Ritov; Alexandre B. Tsybakov

doi:10.1214/08-AOS620

Simultaneous analysis of lasso and dantzig selector

Peter J. Bickel, Ya'acov Ritov, Alexandre B. Tsybakov

Department of Statistics

Research output: Contribution to journal › Article › peer-review

1491 Scopus citations

Abstract

We show that, under a sparsity scenario, the Lasso estimator and the Dantzig selector exhibit similar behavior. For both methods, we derive, in parallel, oracle inequalities for the prediction risk in the general nonparametric regression model, as well as bounds on the ℓp estimation loss for 1 ≤ p ≤ 2 in the linear model when the number of variables can be much larger than the sample size.

Original language	English
Pages (from-to)	1705-1732
Number of pages	28
Journal	Annals of Statistics
Volume	37
Issue number	4
DOIs	https://doi.org/10.1214/08-AOS620
State	Published - Aug 2009

Keywords

Linear models
Model selection
Nonparametric statistics

Access to Document

10.1214/08-AOS620

Cite this

@article{cef25e76ddc24722bf20c249c771ea38,

title = "Simultaneous analysis of lasso and dantzig selector",

abstract = "We show that, under a sparsity scenario, the Lasso estimator and the Dantzig selector exhibit similar behavior. For both methods, we derive, in parallel, oracle inequalities for the prediction risk in the general nonparametric regression model, as well as bounds on the ℓp estimation loss for 1 ≤ p ≤ 2 in the linear model when the number of variables can be much larger than the sample size.",

keywords = "Linear models, Model selection, Nonparametric statistics",

author = "Bickel, {Peter J.} and Ya'acov Ritov and Tsybakov, {Alexandre B.}",

year = "2009",

month = aug,

doi = "10.1214/08-AOS620",

language = "אנגלית",

volume = "37",

pages = "1705--1732",

journal = "Annals of Statistics",

issn = "0090-5364",

publisher = "Institute of Mathematical Statistics",

number = "4",

}

TY - JOUR

T1 - Simultaneous analysis of lasso and dantzig selector

AU - Bickel, Peter J.

AU - Ritov, Ya'acov

AU - Tsybakov, Alexandre B.

PY - 2009/8

Y1 - 2009/8

N2 - We show that, under a sparsity scenario, the Lasso estimator and the Dantzig selector exhibit similar behavior. For both methods, we derive, in parallel, oracle inequalities for the prediction risk in the general nonparametric regression model, as well as bounds on the ℓp estimation loss for 1 ≤ p ≤ 2 in the linear model when the number of variables can be much larger than the sample size.

AB - We show that, under a sparsity scenario, the Lasso estimator and the Dantzig selector exhibit similar behavior. For both methods, we derive, in parallel, oracle inequalities for the prediction risk in the general nonparametric regression model, as well as bounds on the ℓp estimation loss for 1 ≤ p ≤ 2 in the linear model when the number of variables can be much larger than the sample size.

KW - Linear models

KW - Model selection

KW - Nonparametric statistics

UR - http://www.scopus.com/inward/record.url?scp=68649086910&partnerID=8YFLogxK

U2 - 10.1214/08-AOS620

DO - 10.1214/08-AOS620

M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???

AN - SCOPUS:68649086910

SN - 0090-5364

VL - 37

SP - 1705

EP - 1732

JO - Annals of Statistics

JF - Annals of Statistics

IS - 4

ER -

Simultaneous analysis of lasso and dantzig selector

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Cite this