Enhancing Predictive Process Monitoring with Conformal Prediction

  • Conference paper
  • First Online:
Artificial Intelligence Applications and Innovations (AIAI 2024)

Abstract

This paper introduces a framework that integrates Conformal Prediction (CP) with Predictive Process Monitoring (PPM) to enhance prediction accuracy and reliability by producing prediction intervals with a guaranteed coverage rate. The approach followed fills a significant gap in current research as it provides an effective technique for assessing prediction uncertainty, which is vital for making well-informed decisions in various business sectors. Comprehensive experimental research conducted on various datasets demonstrates the framework's ability and effectiveness in providing accurate and reliable predictions of the remaining time required for the completion of a process trace. This work highlights the significance of measuring uncertainty in predictions, providing a substantial contribution to the areas of PPM and CP. It also offers a solid and trustworthy approach for integrating uncertainty quantification into process mining predictive models that contributes to significantly enhanced decision-support.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 299.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. van der Aalst, W.M.P., Pesic, M., Song, M.: Beyond process mining: from the past to present and future. In: Pernici, B. (eds.) Advanced Information Systems Engineering. CAiSE 2010. Lecture Notes in Computer Science, vol. 6051. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-13094-6_5

  2. Maggi, F.M., Di Francescomarino, C., Dumas, M., Ghidini, C.: Predictive monitoring of business processes. In: Jarke, M., et al. Advanced Information Systems Engineering. CAiSE 2014. Lecture Notes in Computer Science, vol. 8484. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07881-6_31

  3. Shafer, G., Vovk, V.: A tutorial on conformal prediction. J. Mach. Learn. Res. 371–421 (2008)

    Google Scholar 

  4. Vovk, V., Gammerman, A., Shafer, G.: Algorithmic Learning in a Random World. Second edition. Springer (2022)

    Google Scholar 

  5. Di Francescomarino, C., Ghidini, C., Maggi, F.M., Milani, F.: Predictive Process Monitoring Methods: Which One Suits Me Best? In: Weske, M., Montali, M., Weber, I., vom Brocke, J. (eds.) BPM 2018. LNCS, vol. 11080, pp. 462–479. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-98648-7_27

    Chapter  Google Scholar 

  6. Teinemaa, I., Dumas, M., La Rosa, M., Maggi, F.M.: Outcome-oriented predictive process monitoring: review and benchmark. In: ACM Transactions on Knowledge Discovery from Data (TKDD), pp. 1–57 (2019)

    Google Scholar 

  7. Van der Aalst, W., Pesic, M.: Process Mining: Discovery, Conformance and Enhancement of Business Processes. Springer, Heidelberg (2011)

    Google Scholar 

  8. Van der Aalst, W., Pesic, M.: Process Mining: Data Science in Action. Springer, Heidelberg (2016)

    Book  Google Scholar 

  9. Chen, T., Guestrin, C.: XGBoost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 785–794. Association for Computing Machinery, New York (2016)

    Google Scholar 

  10. Breiman, L.: Random Forests. Machine Learning (2001)

    Google Scholar 

  11. Rudd, J.M., Ray, H.G.: An empirical study of downstream analysis effects of model pre-processing choices. Open J. Stat. 735–809 (2020)

    Google Scholar 

  12. Neal, R.: Bayesian Learning for Neural Networks. Springer, New York (1996)

    Book  Google Scholar 

  13. Jospin, L.V., Laga, H., Boussaid, F., Buntine, W., Bennamoun, M..: Hands-on Bayesian neural networks—a tutorial for deep learning users. IEEE Comput. Intell. Mag. 29–48 (2022)

    Google Scholar 

  14. Papadopoulos, H., Gammerman, A., Vovk, V.: Normalized nonconformity measures for regression conformal prediction. In: Proceedings of the 26th IASTED International Conference on Artificial Intelligence and Applications (AIA 2008), pp. 64–69. ACTA Press (2008)

    Google Scholar 

  15. Papadopoulos, H., Haralambous, H.: Reliable prediction intervals with regression neural networks. Neural Netw. 24(8), 842–851 (2011)

    Google Scholar 

  16. Eliades C., Papadopoulos H.: A conformal martingales ensemble approach for addressing concept drift. In: Proceedings of the Twelfth Symposium on Conformal and Probabilistic Prediction with Applications, PMLR 204, pp. 328–346 (2023)

    Google Scholar 

  17. Papadopoulos, H., Proedrou, K., Vovk, V., Gammerman, A.: Inductive confidence machines for regression. In: Elomaa, T., Mannila, H., Toivonen, H. (eds.) Machine Learning: ECML 2002. ECML 2002. Lecture Notes in Computer Science, vol. 2430. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-36755-1_29

  18. Wang, C., Cao, J.: Interval-based remaining time prediction for business processes. In: Hacid, H., Kao, O., Mecella, M., Moha, N., Paik, Hy. (eds.) Service-Oriented Computing. ICSOC 2021. Lecture Notes in Computer Science, vol. 13121. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-91431-8_3

  19. Reinkemeyer, L.: Status and future of process mining: from process discovery to process execution. In: van der Aalst, W.M.P., Carmona, J. (eds.) Process Mining Handbook. Lecture Notes in Business Information Processing, vol. 448. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-08848-3_13

  20. Park, G., Song, M.: Optimizing resource allocation based on predictive process monitoring. IEEE Access 11, 38309–38323 (2023)

    Article  Google Scholar 

  21. Taquet, V., Blot, V., Morzadec, T., Lacombe, L., Brunel, N.J.: MAPIE: an open-source library for distribution-free uncertainty quantification. Ar**v, abs/2207.12274 (2022)

    Google Scholar 

  22. Van Dongen, B.F: Bpi challenge 2012. Eindhoven University of Technology (2012). https://doi.org/10.4121/uuid:5f3067df-f10b-45da-b98b-86ae4c7a310b

  23. Van Dongen, B.F: Bpi challenge 2017. Eindhoven University of Technology (2017). https://doi.org/10.4121/uuid:3926db30-f712-4394-aebc-75976070e91f

  24. Polato, M.: Help desk event log. University of Padova (2017). https://doi.org/10.4121/uuid:0c60edf1-6f83-4e75-9367-4c63b3e9d5bb

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Harris Papadopoulos .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Skouvas, F., Papadopoulos, H., Andreou, A.S. (2024). Enhancing Predictive Process Monitoring with Conformal Prediction. In: Maglogiannis, I., Iliadis, L., Macintyre, J., Avlonitis, M., Papaleonidas, A. (eds) Artificial Intelligence Applications and Innovations. AIAI 2024. IFIP Advances in Information and Communication Technology, vol 712. Springer, Cham. https://doi.org/10.1007/978-3-031-63215-0_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-63215-0_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-63214-3

  • Online ISBN: 978-3-031-63215-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation