Almost Sure Asymptotics of Rissanen’s Predictive Stochastic Complexity

  • Chapter
Realization and Modelling in System Theory

Part of the book series: Progress in Systems and Control Theory ((PSCT,volume 3))

Abstract

The aim of this paper is to present a result that for a wide class of stationary ARMA processes Rissanen’s predictive stochastic complexity is asymptotically equal to the lower bound provided by the Rissanen’s-Shannon’s inequality almost surely. An analogous theorem is given for a more easily computable version of the predictive stochastic complexity based on the recursive estimation of the ARMA-parameters.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 42.79
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 53.49
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. R.E. Caines, “Linear Stochastic Systems”, Wiley & Sons, New York, 1988.

    Google Scholar 

  2. M.A.H. Davis, T.E.M. Hemerley, “Strong Consistency of the Predictive Least Squares Criterion for Order Determination of Autoregressive Processes”, Presented at the 4-th Bad Honnef Conference on Stochastic Differential Systems, June 20–24, 1988.

    Google Scholar 

  3. L. Gerencsér, “On the normal approximation of the maximum likelihood estimator of ARMA parameters”, Computer and Automation Institute of the Hungarian Academy of Sciences, Budapest, Working Paper, 1985.

    Google Scholar 

  4. L. Gerencser, “Order estimation of stationary Gaussian ARMA processes using Rissanen’s complexity”, Working Paper, Computer and Automation Institute of the Hungarian Academy of Sciences, 1987. Revised version submitted to the Annals of Statistics.

    Google Scholar 

  5. L. Gerencsér, “Strong approximation of the recursive maximum likelihood estimator of the parameters of an ARMA process”, Working Paper, Computer and Automation Institute of the Hungarian Academy of Sciences, 1987. Submitted to the Annals of Statistics.

    Google Scholar 

  6. L. Gerencsér, J. Rissanen, “A prediction bound for Gaussian ARMA processes”, Proc. of the 25-th CDC, Athens, 1986, Vol.3, 1487–1490.

    Google Scholar 

  7. L. Gerencsér, “On a class of mixing processes”, Stochastics 26 (1989) 165–191.

    Google Scholar 

  8. E.J. Hannan, “The estimation of the order of an ARMA process”, Annals of Statistics 8, (1980), 5, 1071–1081.

    Article  Google Scholar 

  9. E.J. Hannan, (1987) Private communication by J. Rissanen.

    Google Scholar 

  10. T.L. Lai, “Parallel Recursive Algorithms in Stochastic Systems Analysis and Adaptive Control”, presented at the 4-th Bad Honnef Conference on Stochastic Differential Systems, June 20–24, 1988.

    Google Scholar 

  11. J. Rissanen, “Stochastic complexity and modeling”, Annals of Statistics, 14 (1986), 1080–1100.

    Article  Google Scholar 

  12. J. Rissanen, “Stochastic Complexity in Statistical Inquiry”, World Scientific World Scientific Publishing Co., 1989.

    Google Scholar 

  13. T. Speed, (1989), Private communication.

    Google Scholar 

  14. S. Veres, (1988), Private communication by M.A.H. Davis.

    Google Scholar 

  15. M. Wax, “Order selection for AR models by predictive least-squares”, Proc. of the 25-th CDC, Athens, 1986, Vol.3, 1481–1486.

    Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1990 Birkhäuser Boston

About this chapter

Cite this chapter

Gerencsér, L. (1990). Almost Sure Asymptotics of Rissanen’s Predictive Stochastic Complexity. In: Kaashoek, M.A., van Schuppen, J.H., Ran, A.C.M. (eds) Realization and Modelling in System Theory. Progress in Systems and Control Theory, vol 3. Birkhäuser Boston. https://doi.org/10.1007/978-1-4612-3462-3_48

Download citation

  • DOI: https://doi.org/10.1007/978-1-4612-3462-3_48

  • Publisher Name: Birkhäuser Boston

  • Print ISBN: 978-1-4612-8033-0

  • Online ISBN: 978-1-4612-3462-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Navigation