Square-root lasso: pivotal recovery of sparse signals via conic programming
We propose a pivotal method for estimating high-dimensional sparse linear regression models, where the overall number of regressors p is large, possibly much larger than n, but only s regressors are significant. The method is a modification of the lasso, called the square-root lasso. The method is pivotal in that it neither relies on the knowledge of the standard deviation σ nor does it need to pre-estimate σ. Moreover, the method does not rely on normality or sub-Gaussianity of noise. It achieves near-oracle performance, attaining the convergence rate σ{(s/n) log p}-super-1/2 in the prediction norm, and thus matching the performance of the lasso with known σ. These performance results are valid for both Gaussian and non-Gaussian errors, under some mild moment restrictions. We formulate the square-root lasso as a solution to a convex conic programming problem, which allows us to implement the estimator using efficient algorithmic methods, such as interior-point and first-order methods. Copyright 2011, Oxford University Press.
Year of publication: |
2011
|
---|---|
Authors: | Belloni, A. ; Chernozhukov, V. ; Wang, L. |
Published in: |
Biometrika. - Biometrika Trust, ISSN 0006-3444. - Vol. 98.2011, 4, p. 791-806
|
Publisher: |
Biometrika Trust |
Saved in:
Saved in favorites
Similar items by person
-
Inference on treatment effects after selection amongst high-dimensional controls
Belloni, A., (2012)
-
Sparse models and methods for optimal instruments with an application to eminent domain
Belloni, A., (2010)
-
Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain
Belloni, A., (2012)
- More ...