Abstract
This chapter contains a historical introduction and presents the basic elements of the Bayesian approach in probabilities, namely, the notions of exchangeability and De Finetti’s theorem. The combination of uncertainty quantification techniques and Bayesian procedures is introduced, namely, for the practical use of De Finetti’s theorem. Programs in R implement the elements introduced, namely, the representation of probability spaces and De Finetti’s theorem. Their use is exemplified.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Attiaoui, D., Doré, P., Martin, A., & Ben Yaghlane, B. (2012). A Distance between Continuous Belief Functions. In E. Hüllermeier, S. Link, T. Fober, & B. Seeger (Ed.), Scalable Uncertainty Management: SUM 2012 (pp. 194–205). Marburg, Germany: Springer. doi:https://doi.org/10.1007/978-3-642-33362-0_15
Bayes, T., & Price, R. (1763, January 01). An essay towards solving a problem in the doctrine of chances. Philosophical Transactions of the Royal Society of London, 53, pp. 370–418. https://doi.org/10.1098/rstl.1763.0053, https://www.jstor.org/stable/105741?seq=3; https://royalsocietypublishing.org/doi/10.1098/rstl.1763.0053; consulted April 12th 2024.
Benavoli, A. (2014). Belief function and multivalued map** robustness in statistical estimation. International Journal of Approximate Reasoning, 55, 311–329. doi:https://doi.org/10.1016/j.ijar.2013.04.014
Bernardo, J. M., & Smith, A. F. (2000). Bayesian Theory. Bafiins Lane, Chichester, England: John Wiley & Sons.
Boivin, C. (2022a, December 25). https://cran.r-project.org/web/packages/dst/vignettes/Captain_Example.html. Retrieved from Captain’s Example: https://cran.r-project.org/web/packages/dst/vignettes/Captain_Example.html
Boivin, C. (2022b, 12 24). Introduction to Belief Functions. Retrieved from https://cran.r-project.org/web/packages/dst/vignettes/: https://cran.r-project.org/web/packages/dst/vignettes/Introduction_to_Belief_Functions.html#fn2
Boivin, C. (2022c, December 25). Introduction to Belief Functions: The Monty Hall Game. Retrieved 2022, from https://cran.microsoft.com/snapshot/2018-08-11/web/packages/dst/vignettes/Monty-hall-Example.html: https://cran.microsoft.com/snapshot/2018-08-11/web/packages/dst/vignettes/Monty-hall-Example.html
Brown, L. D. (1986). Fundamentals of Statistical Exponential Families with Applications in Statistical Decision Theory (Lecture Notes-Monograph Series, vol. 9 ed.). Hayward, California, USA: Institute of Mathematical Statistics. doi:https://doi.org/10.1214/lnms/1215466757
Campagner, A., Ciucci, D., & Denœux, T. (2022). Belief Functions and Rough Sets: Suvey and New Insights. International Journal of Approximate Reasoning, 143, 92–215. doi:https://doi.org/10.1016/j.ijar.2022.01.011
Cobb, B. R., & Shenoy, P. (2006, April). On the plausibility transformation method for translating belief function models to probability models. Journal of Approximate Reasoning, 41(3), pp. 314–330. doi:https://doi.org/10.1016/j.ijar.2005.06.008
Couso, I., Dubois, D., & Sanchez, L. (2014). Random Sets and Random Fuzzy Sets as Ill-Perceived Random Variables. Springer. doi:https://doi.org/10.1007/978-3-319-08611-8
Dale, A. I. (1982). Bayes or Laplace? An Examination of the Origin and Early Applications of Bayes’ Theorem. Archive for History of Exact Sciences, 27(1), pp. 23–47.
Dale, A. I. (1999). A History of Inverse Probability—From Thomas Bayes to Karl Pearson (2nd. ed.). New York: Springer.
De Finetti, B. (1930). Funzione Caratteristica di un Fenomeno Aleatorio. Memoria della Reale Accademia dei Lincei, IV(5), 86–133. Retrieved 1 29, 2023, from http://www.brunodefinetti.it/Opere/funzioneCaratteristica.pdf
De Finetti, B. (1937). La prévision : ses lois logiques, ses sources subjectives. Annales de l’Institut henri Poïncaré, 7(1), 1–68. Retrieved 1 29, 2023, from http://www.numdam.org/item/AIHP_1937__7_1_1_0.pdf
De Finetti, B. (2017). Theory of Probability—A Critical Introductory Treatment. (A. M. Smith, Trans.) UK: John Wiley and Sons.
DeGroot, M. H. (2004). Optimal Statistical Decisions. New Jersey: John Wiley & Sons.
Dempster, A. (1967, April). Upper and Lower Probabilities Induced by a Multivalued Map**. Ann. Math. Statist., 38(2), pp. 325–339,. doi:https://doi.org/10.1214/aoms/1177698950
Denoeux, T. (2019, June). Decision-making with belief functions: A review. International Journal of Approximate Reasoning, 109, 87–110. doi:https://doi.org/10.1016/j.ijar.2019.03.009
Denoeux, T. (2021). Uncertainty Analysis using Belief Functions: Applications to Statistical Inference and Pattern Recognition. Université de technologie de Compiègne, Department of Computer Science, Compiègne, France. Retrieved December 20, 2022, from https://www.hds.utc.fr/~tdenoeux/dokuwiki/_media/en/book_bf.pdf
Denœux, T., Younes, Z., & Abdallah, F. (2010). Representing uncertainty on set-valued variables using belief functions. Artificial Intelligence, 174(7–8), 479–499. doi:https://doi.org/10.1016/j.artint.2010.02.002
Dezert, J., & Smarandache, F. (2008). A new probabilistic transformation of belief mass assignment. Fusion 2008: International Conference on Information Fusion, (pp. 1410–1417). Retrieved December 19, 2022, from https://hal.archives-ouvertes.fr/hal-00304319/document
Dezert, J., & Smarandache, F. (2009). Transformations of belief masses into subjective probabilities. In J. Dezert, & F. Smarandache (Eds.), Advances and Applications of DSmT for Information Fusion (pp. 85–136). Rehoboth: American Research Press . Retrieved December 19, 2022, from https://www.researchgate.net/publication/306413841_Transformations_of_belief_masses_into_subjective_probabilities
Dezert, J., Smarandache, F., & Daniel, M. (2004). A Generalized Pignistic Transformation. In J. Dezert, & F. Smarandache (Eds.), Advances and Applications of DSmT for Information Fusion (pp. 143–153). Rehoboth: American Research Press. Retrieved December 19, 2022, from https://www.onera.fr/sites/default/files/297/C023-Dezert-Fusion2004Stockholm.pdf
Diaconis, P. (1977). Finite forms of de Finetti’s theorem on exchangeability. Synthese, 36, 271–281. doi:https://doi.org/10.1007/BF00486116
Doré, P. E., Fiche, A., & Martin, A. (2010). Models of belief functions—Impacts for patterns recognitions. 13th International Conference on Information Fusion. Edinburgh, UK. doi:https://doi.org/10.1109/ICIF.2010.5711936
Doré, P., Martin, A., Abi-Zeid, I., Jousselme, A., & Maupin, P. (2011a, January). Belief functions induced by multimodalprobability density functions, an application to the search and rescue problem. RAIRO—Operations Research, 44(4), 323–343. doi:https://doi.org/10.1051/ro/2011001
Doré, P., Osswald, C., Martin, A., Jousselme, A., & Maupin, P. (2011b). Continuous belief functions to qualify sensors performances. In W. Liu (Ed.), Symbolic and Quantitative Approaches to Reasoning with Uncertainty. ECSQARU 2011 (pp. 350–361). Belfast, Ireland: Springer. doi:https://doi.org/10.1007/978-3-642-22152-1_30
Dubois, D., & Prade, H. (1986). A Set-Theoretic View of Belief Functions. International Journal of General Systems, 12(3), 193–226. doi:https://doi.org/10.1080/03081078608934937
Fetz, T., & Oberguggenberger, M. (2016, November). Imprecise random variables, random sets, and Monte Carlo simulation. 78, 252–264. doi:https://doi.org/10.1016/j.ijar.2016.06.012
Fiche, A., Martin, A., Cexus, J.-C., & Khenchaf, A. (2010). Continuous belief functions and α-stable distributions. 13th Conference on Information Fusion. Edinburgh. doi:https://doi.org/10.1109/ICIF.2010.5711934
Fox, C. R., & See, K. E. (2006). Belief and Preference in Decision Under Uncertainty. In D. Hardman, & L. Macchi (Eds.), Thinking: Psychological Perspectives on Reasoning, Judgment and Decision Making. John Wiley & Sons. doi:https://doi.org/10.1002/047001332X.ch14
Fritz, T., Gonda, T., & Perrone, P. (2021). De Finetti’s Theorem in Caqtegorical Probability. Journal of Stochastic Analysis, 2(4). doi:https://doi.org/10.31390/josa.2.4.06
Gavalakis, L., & Kontoyiannis, I. (2021). An information-theoretic proof of a finite de Finetti theorem. Electronic Communications in Probability, 26, 1–5. doi:https://doi.org/10.1214/21-ECP428
Guan, J., & Bell, D. (1993). Discounting and Combination Operations in Evidential Reasoning. In D. Heckerman, & A. Mamdani (Ed.), Ninth Conference on Uncertainty in Artificial Intelligence (pp. 477–484). Washington, USA: Elsevier. doi:https://doi.org/10.1016/B978-1-4832-1451-1.50062-7
Halmos, P. (1978). Measure theory. Berlin, Heidelberg, New York: : Springer Verlag.
Halpern, J., & Fagin, R. (1992). Two views of belief: belief as generalized probability and belief as evidence. Artificial Intelligence,, 54, pp. 275–317.
He, Y. (2013). Uncertainty Quantification and Data Fusion based on Dempster-Shafer Theory. Florida State University, Mathematics. Florida State University Libraries.
Hewitt, E., & Savage, L. (1955). Symmetric Measures on Cartesian Products. Transactions of The American Mathematical Society, 80(2), 470–501. doi:https://doi.org/10.2307/1992999
Hill, B. M., Lane, D., & Sudderth, W. (1987). Exchangeable Urn Processes. Ann. Probab., 15(4), 1586–1592. doi:https://doi.org/10.1214/aop/1176991995
Howson, C., & Urbach, P. (2006). Scientific reasoning : the Bayesian approach . Chicago: Open Court.
Hüllermeier, E., Kruse, R., & Hoffmann, F. (Eds.). (2010). Consonant continuous belief functions conflicts calculation. IPMU’10: Proceedings of the Computational intelligence for knowledge-based systems design, and 13th international conference on Information processing and management of uncertainty (pp. 706–715). Dortmund, Germany: Springer.
Ivanoff, B. G., & Weber, N. (2004). Predictable sampling for partially exchangeable arrays. Statistics & Probability Letters, 70(1), 95–108. doi:https://doi.org/10.1016/j.spl.2004.08.005
Jaffray, J.-Y., & Wakker, P. (1993). Decision making with belief functions: Compatibility and incompatibility with the sure-thing principle. Journal of Risk and Uncertainty, 7(3), 255–271. doi:https://doi.org/10.1007/BF01079626
Jaynes, E. (1989). Clearing up Mysteries—The Original Goal. (J. Skilling, Ed.) Dordrecht: Springer. doi:https://doi.org/10.1007/978-94-015-7860-8_1
Jaynes, E. (2003). Probability Theory: The Logic of Science. Cambridge: Cambridge University Press.
Jeffreys, H. (1939). Theory of probability. Oxford: University Press.
Kallenberg, O. (1988). Spreading and Predictable Sampling in Exchangeable Sequences and Processes. The Annals of Probability, 16(2), 508–534. doi:https://doi.org/10.1214/aop/1176991771
Kallenberg, O. (1989). On the representation theorem for exchangeable arrays. Journal of Multivariate Analysis, 30(1), 137–154. doi:https://doi.org/10.1016/0047-259X(89)90092-4
Klopotek, M. A., & Wierzchon, S. T. (1998). A New Qualitative Rough-Set Approach to Modeling Belief Functions. In L. Polkowski, & A. Skowron (Ed.), Rough Sets and Current Trends in Computing, First International Conference, RSCTC’98 (pp. 346–354). Warzsaw, Poland: Springer. doi:https://doi.org/10.1007/3-540-69115-4_47
Laghmara, H., Laurain, T., Cudel, C., & Lauffenburger, J. P. (2020). Heterogeneous sensor data fusion for multiple object association using belief functions. Information Fusion, 57, 44–58. doi:https://doi.org/10.1016/j.inffus.2019.11.002
Laplace, P.-S. (1774). Memoire sur la probabilité des causes par les événements. Memoires de Mathématique et de Physique, Presentés à l’Académie Royale des Sciences par divers Savans & lus dans ses Assemblées, pp. 621–656.
Laplace, P.-S. (1891). Oeuvres complètes (Vol. 8). (A. d. Paris, Ed.) Paris: Gauthiers-Villars.
Laplace, P.-S. (1986). Memoir on the Probability of the Causes of Events. Statistical Science, 1(3), pp. 364–78. Retrieved from http://www.jstor.org/stable/2245476
Lévy, P. (1922, November 13). Sur la détermination des lois de probabilité par leurs fonctions caractéristiques. Comptes Rendus de l’Académie des Sciences de Paris, pp. 854–856.
Lian, C. (2017). Information Fusion and Decision Making using Belief Functions. Compiègne, France: Université de Technologie de Compiègne.
Liu, W. (2006, August). Analyzing the degree of conflict among belief functions. Artificial Intelligence, 170 (11), 909–924. doi:https://doi.org/10.1016/j.artint.2006.05.002
Martin, A. (2019). Conflict management in information fusion with belief functions. In E. Bossé, & G. Rogova (Eds.), Information quality in information fusion and decision making (pp. 79–97). Springer. doi:https://doi.org/10.1007/978-3-030-03643-0_4
Martin, R., Zhang, J., & Liu, C. (2010, June). Dempster–Shafer Theory and Statistical Inference with Weak Beliefs. Statistical Science, 25(1), 72–87. doi:https://doi.org/10.1214/10-STS322
Mercier, D., Quost, B., & Denœux, T. (2005). Contextual Discounting of Belief Functions. In L. Godo (Ed.), ECSQARU 2005: Symbolic and Quantitative Approaches to Reasoning with Uncertainty (pp. 552–562). Barcelona, Spain: Springer. doi:https://doi.org/10.1007/11518655_47
Miranda, E., Couso, I., & Gil, P. (2005, July). Random sets as imprecise random variables. Journal of Mathematical Analysis and Applications, 307(1), 32–47. doi:https://doi.org/10.1016/j.jmaa.2004.10.022
Nguyen, H. T. (1977). On Random sets and Belief Functions. University of California, Berkeley, EECS Department. Retrieved from http://www2.eecs.berkeley.edu/Pubs/TechRpts/1977/28879.html
Nguyen, H. T. (1978). On Random Sets and Belief Functions. Journal of Mathematical Analysis and Applications, 65, 531–542. doi:https://doi.org/10.1016/0022-247X(78)90161-0
Nguyen, H., & Wang, T. (1997). Belief Functions and Random Sets. In J. Goutsias, R. Mahler, & H. Nguyen (Eds.), Random Sets (pp. 243–255). Springer. doi:https://doi.org/10.1007/978-1-4612-1942-2_11
Ni, S., Lei, Y., & Tang, Y. (2020). Improved Base Belief Function-Based Conflict Data Fusion Approach Considering Belief Entropy in the Evidence Theory. Entropy, 22(8). doi:https://doi.org/10.3390/e22080801
Polya, G. (1930). Sur quelques points de la théorie des probabilités. Annales de l’Institut Penri Poïncaré, 1(2), 117–161. Retrieved 1 29, 2023, from http://www.numdam.org/article/AIHP_1930__1_2_117_0.pdf
Press, S. J., & Tanur, J. M. (2001). The Subjectivity of Scientists and the Bayesian Approach. New York: John Wiley & Sons.
Risti, B., & Smets, P. (2006). Belief function theory on the continuous space with an application to model based classification. In B. Bouchon-Meunier, G. Coletti, & R. R. Yager (Ed.), Modern Information Processing: From Theory to Applications. IPMU’04 (pp. 11–24). Perugia, Italy.: Elsevier. doi:https://doi.org/10.1016/B978-044452075-3/50002-9
Savchuk, V. P., & Tsokos, C. P. (2011). Bayesian Theory and Methods with Applications. Paris: Atlantis Press.
Shafer, G. (1976). A Mathematical Theory of Evidence . New Jersey: Princeton University Press.
Shafer, G. (1990). Perspectives on the Theory and Practice of Belief Functions. International Journal of Approximate Reasoning, 4(5–6), 323–362. doi:https://doi.org/10.1016/0888-613X(90)90012-Q
Smets, P. (1990). Constructing the Pignistic Probability Function in a Context of Uncertainty. Machine Intelligence and Pattern Recognition, 10, 29–39. doi:https://doi.org/10.1016/B978-0-444-88738-2.50010-5
Smets, P. (2000). Data fusion in the transferable belief model. Proceedings of the Third International Conference on Information Fusion. 1, pp. 21–33. Paris, France: IEEE. doi:https://doi.org/10.1109/IFIC.2000.862713.
Smets, P. (2005). Belief functions on real numbers. International Journal of Approximate Reasoning, 40, 181–223. doi:https://doi.org/10.1016/j.ijar.2005.04.001
Souza de Cursi, E. (2023). Uncertainty Quantification using R. Springer Cham.
Stigler, S. M. (1982). Thomas Bayes’s Bayesian Inference. Journal of the Royal Statistical Society. Series A (General), 145(2), pp. .250–258.
Strat, T. (1984). Continuous belief functions for evidential reasoning. Proceedings of the 4th National Conference on Artificial Intelligence. Austin, Texas. Retrieved December 18, 2022, from https://www.aaai.org/Papers/AAAI/1984/AAAI84-035.pdf
Strat, T. (1987). The Generation of Explanations within Evidential Reasoning Systems. In J. P. McDermott (Ed.), 10th. International Joint Conference on Artificial Intelligence (IJCAI), (pp. 1097–1104). Milan, Italy. Retrieved December 20, 2022, from https://www.ijcai.org/Proceedings/87-2/Papers/104.pdf
Strat, T. (1990). Decision analysis using belief functions. International Journal of Approximate Reasoning, 4(5–6), 391–417. doi:https://doi.org/10.1016/0888-613X(90)90014-S
Sundberg, R. (2019). Statistical Modelling by Exponential Families. Cambridge, UK: Cambridge University Press. doi:https://doi.org/10.1017/9781108604574
Svante, J., Takis, K., & Linglong, Y. (2016). On a representation theorem for finitely exchangeable random vectors. Journal of Mathematical Analysis and Applications, 442(2), 703–714. doi:https://doi.org/10.1016/j.jmaa.2016.04.070
Taillandier, P., & Therond, O. (2011). Use of the Belief Theory to formalize Agent DecisionMaking Processes : Application to crop** Plan Decision Making. European Simulation and Modelling Conference, (pp. 138–142). Guimaraes, Portugal. Retrieved 12 17, 2022, from https://hal.archives-ouvertes.fr/hal-00688405
Wasserman, L. A. (1990, September). Belief functions and statistical inference. Canadian Journal of Statistics, 18(3), 183–196. doi:https://doi.org/10.2307/3315449
Witkovský, V. (2016). Numerical inversion of a characteristic function: An alternative tool to form the probability distribution of output quantity in linear Measurement models. ACTA IMEKO, 5(3), 32–44. doi:https://doi.org/10.21014/acta_imeko.v5i3.382.
Wu, W.-Z., & Mi, J.-S. (2008). An Interpretation of Belief Functions on Infinite Universes in the Theory of Rough Sets. In C. Chan, J. Grzymala-Busse, & W. P. Ziarko (Ed.), Rough Sets and Current Trends in Computing. RSCTC 2008 (pp. 71–80). Akron, OH, USA: Springer. doi:https://doi.org/10.1007/978-3-540-88425-5_8
Yao, Y. Y., & Lingras, P. J. (1998). Interpretations of Belief Functions in the Theory of Rough Sets. Information Sciences, 104(1–2), 81–106. doi:https://doi.org/10.1016/S0020-0255(97)00076-5
Zhang, H., & Deng, Y. (2020). Weighted belief function of sensor data fusion in engine fault diagnosis. Soft Comput, 24, 2329–2339. doi:https://doi.org/10.1007/s00500-019-04063-7
Zhou, K., Martin, A., & Pan, Q. (2018). A belief combination rule for a large number of sources. .Journal of Advances in Information Fusion, 13(2). Retrieved December 2022, 20, from https://www.researchgate.net/deref/https%3A%2F%2Fhal.archives-ouvertes.fr%2Fhal-01883239
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Souza de Cursi, E. (2024). Basic Bayesian Probabilities. In: Uncertainty Quantification with R. International Series in Operations Research & Management Science, vol 352. Springer, Cham. https://doi.org/10.1007/978-3-031-48208-3_1
Download citation
DOI: https://doi.org/10.1007/978-3-031-48208-3_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-48207-6
Online ISBN: 978-3-031-48208-3
eBook Packages: Business and ManagementBusiness and Management (R0)