Parametrized Measure Models

  • Chapter
  • First Online:
Information Geometry

Abstract

This chapter represents the most important technical achievement of this book, a combination of functional analysis and geometry as the natural framework for families of probability measures on general sample spaces. In order to work on such a sample space, one needs a base or reference measure. Other measures, like those in a parametric family, are then described by densities w.r.t. this base measure. Such a base measure, however, is not canonical, and it can be changed by multiplication with an \(L^{1}\)-function. But then, also the description of a parametric family by densities changes. Kee** track of the resulting functorial behavior and pulling it back to the parameter spaces of a parametric family is the key that unlocks the natural functional analytical properties of parametric families. We develop the appropriate differentiability and integrability concepts. In particular, we shall need roots (half-densities) and other fractional powers of densities. For instance, when the sample space is a differentiable manifold, its diffeomorphism group operates isometrically on the space of half-densities with their \(L^{2}\)-product. The latter again yields the Fisher metric. At the end of this chapter, we compare our framework with that of Pistone–Sempi which depends on an analysis of integrability properties under exponentiation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 93.08
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 117.69
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info
Hardcover Book
EUR 160.49
Price includes VAT (Germany)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    \({\varOmega }\) will take over the role of the finite sample space \(I\) in Sect. 2.1.

  2. 2.

    For reasons of integrability, this structure need not define an affine space in the sense of Sect. 2.8.1. We only have the structure of an affine manifold, in the sense of possessing affine coordinate changes. This issue will be clarified in Sect. 3.2 below.

  3. 3.

    Again, we are employing a fundamental mathematical principle here: Instead of considering objects in isolation, we rather focus on the transformations between them. Thus, instead of an individual basis, we consider the transformation that generates it from some (arbitrarily chosen) standard basis. This automatically gives a very powerful structure, that of a group (of transformations).

  4. 4.

    More precisely, \({\mathcal {M}}_{+}({\varOmega }, \mu_{0})\) is not open unless \({\varOmega }\) is the disjoint union of finitely many \(\mu_{0}\)-atoms, where \(A {\subseteq }{\varOmega }\) is a \(\mu _{0}\)-atom if for each \(B {\subseteq }A\) either \(B\) or \(A\backslash B\) is a \(\mu_{0}\)-null set.

  5. 5.

    Observe that the factor \(1/4\) in (3.89) by which the canonical form differs from the Hilbert inner product is responsible for having to use the sphere of radius 2 rather than the unit sphere in Proposition 2.1.

  6. 6.

    In [216] the Young function \(\cosh t - 1\) was used instead of \(\exp |t| - 1\). However, these produce equivalent Orlicz spaces by Proposition 3.9.

References

  1. Aliprantis, C., Border, K.: Infinite Dimensional Analysis. Springer, Berlin (2007)

    MATH  Google Scholar 

  2. Amari, S.: Differential-Geometric Methods in Statistics. Lecture Notes in Statistics, vol. 28. Springer, Heidelberg (1985)

    Book  MATH  Google Scholar 

  3. Amari, S.: Differential geometrical theory of statistics. In: Differential Geometry in Statistical Inference, Institute of Mathematical Statistics, California. Lecture Notes–Monograph Series, vol. 10 (1987)

    Google Scholar 

  4. Amari, S., Nagaoka, H.: Methods of Information Geometry. Translations of Mathematical Monographs, vol. 191. Am. Math. Soc./Oxford University Press, Providence/London (2000)

    MATH  Google Scholar 

  5. Ay, N., Jost, J., Lê, H.V., Schwachhöfer, L.: Information geometry and sufficient statistics. Probab. Theory Relat. Fields 162, 327–364 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  6. Ay, N., Jost, J., Lê, H.V., Schwachhöfer, L.: Parametrized measure models. Bernoulli (2015). To appear, ar**v:1510.07305

  7. Friedrich, Th.: Die Fisher-Information und symplektische Strukturen. Math. Nachr. 152, 273–296 (1991)

    Article  MathSciNet  MATH  Google Scholar 

  8. Fukumizu, K.: Exponential manifold by reproducing kernel Hilbert spaces. In: Gibilisco, P., Riccomagno, E., Rogantin, M.-P., Winn, H. (eds.) Algebraic and Geometric Methods in Statistics, pp. 291–306. Cambridge University Press, Cambridge (2009)

    Chapter  Google Scholar 

  9. Gibilisco, P., Pistone, G.: Connections on non-parametric statistical models by Orlicz space geometry. Infin. Dimens. Anal. Quantum Probab. Relat. Top. 1(2), 325–347 (1998)

    Article  MathSciNet  MATH  Google Scholar 

  10. Krasnosel’skii, M.A., Rutickii, Ya.B.: Convex functions and Orlicz spaces. Fizmatgiz, Moscow (1958) (In Russian); English translation: P. Noordfoff Ltd., Groningen (1961)

    Google Scholar 

  11. Lauritzen, S.: Statistical manifolds. In: Differential Geometry in Statistical Inference, Institute of Mathematical Statistics, California. Lecture Note-Monograph Series, vol. 10 (1987)

    Google Scholar 

  12. Lovrić, M., Min-Oo, M., Ruh, E.: Multivariate normal distributions parametrized as a Riemannian symmetric space. J. Multivar. Anal. 74, 36–48 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  13. Moser, J.: On the volume elements on a manifold. Trans. Am. Math. Soc. 120, 286–294 (1965)

    Article  MathSciNet  MATH  Google Scholar 

  14. Murray, M., Rice, J.: Differential Geometry and Statistics. Chapman & Hall, London (1993)

    Book  MATH  Google Scholar 

  15. Neveu, J.: Bases Mathématiques du Calcul de Probabilités, deuxième édition. Masson, Paris (1970)

    MATH  Google Scholar 

  16. Newton, N.: An infinite-dimensional statistical manifold modelled on Hilbert space. J. Funct. Anal. 263, 1661–1681 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  17. Pistone, G., Sempi, C.: An infinite-dimensional structure on the space of all the probability measures equivalent to a given one. Ann. Stat. 23(5), 1543–1561 (1995)

    Article  MathSciNet  MATH  Google Scholar 

  18. Rao, C.R.: Information and the accuracy attainable in the estimation of statistical parameters. Bull. Calcutta Math. Soc. 37, 81–89 (1945)

    MathSciNet  MATH  Google Scholar 

  19. Santacroce, M., Siri, P., Trivellato, B.: New results on mixture and exponential models by Orlicz spaces. Bernoulli 22(3), 1431–1447 (2016)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Ay, N., Jost, J., Lê, H.V., Schwachhöfer, L. (2017). Parametrized Measure Models. In: Information Geometry. Ergebnisse der Mathematik und ihrer Grenzgebiete. 3. Folge / A Series of Modern Surveys in Mathematics, vol 64. Springer, Cham. https://doi.org/10.1007/978-3-319-56478-4_3

Download citation

Publish with us

Policies and ethics

Navigation