SpringerLink
Log in

Simultaneous variable selection and parametric estimation for quantile regression

  • Published:
Journal of the Korean Statistical Society Aims and scope Submit manuscript

Abstract

In this paper, variable selection techniques in the linear quantile regression model are mainly considered. Based on the penalized quantile regression model, a one-step procedure that can simultaneously perform variable selection and coefficient estimation is proposed. The proposed procedure has three distinctive features: (1) By considering quantile regression, the set of relevant variables can vary across quantiles, thus making it more flexible to model heterogeneous data; (2) The one-step estimator has nice properties in both theory and practice. By applying SCAD penalty (Fan and Li, 2001) and Adaptive-LASSO penalty (Zou, 2006), we establish the oracle property for the sparse quantile regression under mild conditions. Computationally, the one-step estimator is fast, dramatically reducing the computation cost; (3) We suggest a BIC-like tuning parameter selector for the penalized quantile regression and demonstrate the consistency of this criterion. That is to say the true model can be identified consistently based on the BIC-like criterion, making our one-step estimator more reliable practically. Monte Carlo simulation studies are conducted to examine the finite-sample performance of this procedure. Finally, we conclude with a real data analysis. The results are promising.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Canada)

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Akaike, H. (1969). Fitting autoregressive models for prediction. Annals of the Institute of Statistical Mathematics, 21(1), 243–247.

    Article  MathSciNet  Google Scholar 

  • Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In Second international symposium on information theory (pp. 267-281). Akademinai Kiado.

    MATH  Google Scholar 

  • Allen, D. M. (1974). The relationship between variable selection and data augmentation and a method for prediction. Technometrics, 16(1), 125–127.

    Article  MathSciNet  Google Scholar 

  • Breiman, L. (1996). Heuristics of instability and stabilization in model selection. The Annals of Statistics, 24, 2350–2383.

    Article  MathSciNet  Google Scholar 

  • Craven, P., & Wahba, G. (1979). Smoothing noisy data with spline functions: estimating the correct degree of smoothing by the method of generalized cross-validation. Numerische Mathematik, 31, 377–403.

    Article  MathSciNet  Google Scholar 

  • Efron, B. (1979). Bootstrap methods: another look at the jackknife. The Annals of Statistics, 1-26.

  • Fan, J., & Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of American Statistical Association, 96, 1348–1360.

    Article  MathSciNet  Google Scholar 

  • Foster, D. P., & George, E. I. (1994). The risk inflation criterion for multiple regression. The Annals of Statistics, 1947–1975.

    MATH  Google Scholar 

  • Koenker, R. (2005). Quantile regression. Cambridge Univ. Press.

    Book  Google Scholar 

  • Koenker, R., & Bassett, G. (1978). Regression quantiles. Econometrica, 46, 33–50.

    Article  MathSciNet  Google Scholar 

  • Li, Y., & Zhu, J. (2007). L1-norm quantile regression. Journal of Computational and Graphical Statistics, 17, 163–185.

    Article  Google Scholar 

  • Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6(2), 461–464.

    Article  MathSciNet  Google Scholar 

  • Stone, M. (1974). Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society. Series B. Statistical Methodology, 111-147.

  • Wang, H., Li, R., & Tsai, C. (2007). Tuning parameter selectors for the smoothly clipped absolute deviation method. Biometrika, 94, 553–568.

    Article  MathSciNet  Google Scholar 

  • Wu, Y., & Liu, Y. (2009). Variable selection in quantile regression. Statistica Sinica, 19, 801–817.

    MathSciNet  MATH  Google Scholar 

  • Zou, H. (2006). The adaptive lasso and its oracle properties. Journal of the American Statistical Association, 101, 1418–1429.

    Article  MathSciNet  Google Scholar 

  • Zou, H., & Li, R. (2008). One-step sparse estimates in nonconcave penalized likelihood models. The Annals of Statistics, 36, 1509–1533.

    Article  MathSciNet  Google Scholar 

  • Zou, H., & Yuan, M. (2008). Composite quantile regression and the oracle model selection theory. The Annals of Statistics, 36, 1108–1126.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Center for Applied Statistics, The School of Statistics, Renmin University of China, Bei**g, 100872, China

    Wei **ong & Maozai Tian

Authors
  1. Wei **ong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maozai Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maozai Tian.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

**ong, W., Tian, M. Simultaneous variable selection and parametric estimation for quantile regression. J. Korean Stat. Soc. 44, 134–149 (2015). https://doi.org/10.1016/j.jkss.2014.06.003

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1016/j.jkss.2014.06.003

AMS 2000 subject classifications

Keywords

Search

Navigation