Log in

Bayesian analysis of testing general hypotheses in linear models with spherically symmetric errors

  • Original Paper
  • Published:
TEST Aims and scope Submit manuscript

Abstract

We consider Bayesian analysis for testing the general linear hypotheses in linear models with spherically symmetric errors. These error distributions not only include some of the classical linear models as special cases, but also reduce the influence of outliers and result in a robust statistical inference. Meanwhile, the design matrix is not necessarily of full rank. By appropriately modifying mixtures of g-priors for the regression coefficients under some general linear constraints, we derive closed-form Bayes factors in terms of the ratio between two Gaussian hypergeometric functions. The proposed Bayes factors rely on the data only through the modified coefficient of determinations of the two models and are shown to be independent of the error distributions, so long as they are spherically symmetric. Moreover, we establish the results of the model selection consistency with the proposed Bayes factors in the model settings with a full-rank design matrix when the number of parameters increases with the sample size. We carry out simulation studies to assess the finite sample performance of the proposed methodology. The presented results extend some existing Bayesian testing procedures in the literature.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Bayarri MJ, Berger JO, Forte A, García-Donato G (2012) Criteria for Bayesian model choice with application to variable selection. Ann Statist 40:1550–1577

    Article  MathSciNet  Google Scholar 

  • Bayarri MJ, García-Donato G (2007) Extending conventional priors for testing general hypotheses in linear models. Biometrika 94:135–152

    Article  MathSciNet  Google Scholar 

  • Berger JO (1985) Statistical decision theory and Bayesian analysis, 2nd edn. Spring-Verlag, Germany

    Book  Google Scholar 

  • Butler RW, Wood AT (2002) Laplace approximations for hypergeometric functions with matrix argument. Ann Statist 30:1155–1177

    Article  MathSciNet  Google Scholar 

  • Celeux G, El Anbari M, Marin J-M, Robert CP (2012) Regularization in regression: comparing Bayesian and frequentist methods in a poorly informative situation. Bayesian Anal 7:477–502

    Article  MathSciNet  Google Scholar 

  • Cheng C-I, Speckman PL (2016) Bayes factors for smoothing spline ANOVA. Bayesian Anal 11:957–975

    Article  MathSciNet  Google Scholar 

  • Cui H, Guo W, Zhong W (2018) Test for high-dimensional regression coefficients using refitted cross-validation variance estimation. Ann Stat 46:958–988

    Article  MathSciNet  Google Scholar 

  • Fonseca TCO, Ferreira MAR, Migon HS (2008) Objective Bayesian analysis for the Student-\(t\) regression model. Biometrika 95:325–333

    Article  MathSciNet  Google Scholar 

  • García-Donato G, Paulo R (2022) Variable selection in the presence of factors: a model selection perspective. J Am Stat Assoc 117:1847–1857

    Article  MathSciNet  Google Scholar 

  • Girón FJ, Moreno E, Casella G, Martínez ML (2010) Consistency of objective Bayes factors for nonnested linear models and increasing model dimension. RACSAM Rev R Acad Cien Ser A Mat 104:57–67

    Article  MathSciNet  Google Scholar 

  • Guo R, Speckman PL (2009) Bayes factor consistency in linear models. In: the 2009 international workshop on objective Bayes methodology, Philadelphia, June 5-9, 2009

  • Hankin RKS (2016) hypergeo: the Gauss hypergeometric function. R package version 1.2-13

  • Jeffreys H (1961) Theory of Probability. Statistics and Computing, 3rd edn. Oxford University Press, London

    Google Scholar 

  • Kass RE, Raftery AE (1995) Bayes factors. J Am Stat Assoc 90:773–795

    Article  MathSciNet  Google Scholar 

  • Kass RE, Vaidyanathan SK (1992) Approximate Bayes factors and orthogonal parameters, with application to testing equality of two binomial proportions. J Roy Stat Soc Ser B 54:129–144

    MathSciNet  Google Scholar 

  • Ley E, Steel MFJ (2012) Mixtures of \(g\)-priors for Bayesian model averaging with economic applications. J Econometrics 171:251–266

    Article  MathSciNet  Google Scholar 

  • Liang F, Paulo R, Molina G, Clyde MA, Berger JO (2008) Mixtures of \(g\)-priors for Bayesian variable selection. J Am Stat Assoc 103:410–423

    Article  MathSciNet  Google Scholar 

  • Maruyama Y (2012) A Bayes factor with reasonable model selection consistency for ANOVA model. Ar**v:0906.4329v2 [stat.ME]

  • Maruyama Y, George EI (2011) Fully Bayes factors with a generalized \(g\)-prior. Ann Statist 39:2740–2765

    Article  MathSciNet  Google Scholar 

  • Maruyama Y, Strawderman WE (2014) Robust Bayesian variable selection in linear models with spherically symmetric errors. Biometrika 101:992–998

    Article  MathSciNet  Google Scholar 

  • Min X, Sun D (2016) Bayesian model selection for a linear model with grouped covariates. Ann Inst Statist Math 68:877–903

    Article  MathSciNet  Google Scholar 

  • Moreno E, Girón FJ, Casella G (2010) Consistency of objective Bayes factors as the model dimension grows. Ann Statist 38:1937–1952

    Article  MathSciNet  Google Scholar 

  • Mukhopadhyay M, Samanta T (2017) A mixture of \(g\)-priors for variable selection when the number of regressors grows with the sample size. TEST 26:377–404

    Article  MathSciNet  Google Scholar 

  • Ouyang L, Zhu S, Ye K, Park C, Wang M (2022) Robust Bayesian hierarchical modeling and inference using scale mixtures of normal distributions. IISE Trans 54:659–671

    Google Scholar 

  • Wang M (2017) Mixtures of \(g\)-priors for analysis of variance models with a diverging number of parameters. Bayesian Anal 12:511–532

    Article  MathSciNet  Google Scholar 

  • Wang M, Maruyama Y (2016) Consistency of Bayes factor for nonnested model selection when the model dimension grows. Bernoulli 22:2080–2100

    Article  MathSciNet  Google Scholar 

  • Wang M, Maruyama Y (2018) Posterior consistency of \(g\)-prior for variable selection with a growing number of parameters. J Stat Plann Inference 196:19–29

    Article  MathSciNet  Google Scholar 

  • Wang M, Sun X (2013) Bayes factor consistency for unbalanced ANOVA models. Statistics 47:1104–1115

    Article  MathSciNet  Google Scholar 

  • Wang M, Sun X (2014) Bayes factor consistency for nested linear models with a growing number of parameters. J Stat Plann Inference 147:95–105

    Article  MathSciNet  Google Scholar 

  • Wang S, Cui H (2013) Generalized F test for high dimensional linear regression coefficients. J Multivariate Anal 117:134–149

    Article  MathSciNet  Google Scholar 

  • **ang R, Ghosh M, Khare K (2016) Consistency of Bayes factors under hyper \(g\)-priors with growing model size. J Stat Plann Infer 173:64–86

    Article  MathSciNet  Google Scholar 

  • Zellner A (1986) On assessing prior distributions and Bayesian regression analysis with \(g\)-prior distributions. In: Bayesian inference and decision techniques, vol. 6 of Stud. Bayesian Econometrics Statist. North-Holland, Amsterdam, pp. 233–243

  • Zhong P-S, Chen SX (2011) Generalized \(F\) test for high dimensional linear regression coefficients. J Am Stat Assoc 106:260–274

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge the comments and suggestions from the two reviewers, which have substantially improved the quality of the manuscript. The work of Zifei Han was partially supported by the National Natural Science Foundation of China (No. 12201112 and No. 12371264) and by “the Fundamental Research Funds for the Central Universities, China” in UIBE (CXTD14-05). The work of Drs. Keying Ye and Min Wang was partially supported by the Internal Research Awards (INTRA) program from the UTSA Vice President for Research, Economic Development, and Knowledge Enterprise at the University of Texas at San Antonio.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zifei Han.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file 1 (pdf 317 KB)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, M., Ye, K. & Han, Z. Bayesian analysis of testing general hypotheses in linear models with spherically symmetric errors. TEST 33, 251–270 (2024). https://doi.org/10.1007/s11749-023-00892-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11749-023-00892-9

Keywords

Mathematics Subject Classification

Navigation