User Behavior Analysis in Online Health Community Based on Inverse Reinforcement Learning

  • Conference paper
  • First Online:
E-Business. New Challenges and Opportunities for Digital-Enabled Intelligent Future (WHICEB 2024)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 517))

Included in the following conference series:

  • 132 Accesses

Abstract

With the rapid development of the Internet, online health communities (OHCs) have gradually become an important platform for the public to seek medical services. User behavior research, an interesting research topic in OHCs, has garnered widespread academic attention in information management. While traditional quantitative and qualitative studies remain foundational, a growing number of scholars have shifted their focus toward harnessing machine learning techniques to delve deeply into OHC user behaviors, aiming to extract actionable insights for community refinement and decision-making. Given the substantial data volume of OHCs, there remains a gap in employing reinforcement learning for relevant studies. This paper embarks on a detailed analysis and predictions of user behaviors in breast cancer OHCs using inverse reinforcement learning. Research findings suggest that users are more likely to initiate new discussions, respond to others, and self-reply after receiving peer replies. Moreover, the rewards obtained through inverse reinforcement learning serve as compelling features for predicting future user behavior. The F1 value of the prediction increased by 13% and 24% in the dataset with time windows of 3 years and 5 years. The findings may contribute to the effective management and sustainable development of OHCs.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 111.27
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 79.17
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Mo, P.K.H., Coulson, N.S.: Online support group use and psychological health for individuals living with hiv/aids. Patient Educ. Couns. 93(3), 426–432 (2013)

    Article  Google Scholar 

  2. Zhang, Y., He, D., Sang, Y.: Facebook as a platform for health information and communication: a case study of a diabetes group. J. Med. Syst. 37, 1–12 (2013)

    Article  Google Scholar 

  3. Price, S.L., et al.: Maternal knowing and social networks: understanding first-time mothers’ search for information and support through online and offline social networks. Qual. Health Res. 28(10), 1552–1563 (2018)

    Article  Google Scholar 

  4. Barrera, M., Jr., Ainlay, S.L.: The structure of social support: A conceptual and empirical analysis. J. Commun. Psychol. 11(2), 133–143 (1983)

    Article  Google Scholar 

  5. Mirzaei, T., Esmaeilzadeh, P.: Engagement in online health communities: channel expansion and social exchanges. Inf. Manage. 58(1), 103404 (2021)

    Article  Google Scholar 

  6. Wang, X., Zhao, K., Street, N., et al.: Analyzing and predicting user participations in online health communities: a social support perspective. J. Med. Internet Res. 19(4), e6834 (2017)

    Article  Google Scholar 

  7. Laeeq Khan, M.: Social media engagement: What motivates user participation and consumption on youtube? Comput. Human Behavior 66, 236–247 (2017)

    Article  Google Scholar 

  8. Wang, J., Yao, T., Wang, Y.: Patient engagement as contributors in online health communities: the mediation of peer involvement and moderation of community status. Behav. Sci. 13(2), 152 (2023)

    Article  Google Scholar 

  9. Yao, Z., et al.: Join, stay or go? A closer look at members’ life cycles in online health comunities. Proc. ACM Hum.-Comput. Interact. 5(11), 1–22 (2021)

    MathSciNet  Google Scholar 

  10. Feng, B., Li, X., Lin, L.: Valenced social identities and the digital divide in online health communities. Comput. Hum. Behav. 122, 106812 (2021)

    Article  Google Scholar 

  11. Ouyang, P., Wang, J.-J., Ali, U.: The impact of gamification on the patient’s engagement in the online health community. Aslib J. Inf. Manage. 74(6), 1196–1213 (2022)

    Article  Google Scholar 

  12. Kaelbling, L.P., Littman, M.L., Moore, A.W.: Reinforcement learning: a survey. J. Artif. Intell. Res. 4, 237–285 (1996)

    Article  Google Scholar 

  13. Panjasuchat, M., Limpiyakorn, Y.: Applying reinforcement learning for customer churn prediction. In: Journal of Physics: Conference Series, vol. 1619, p. 012016. IOP Publishing (2020)

    Google Scholar 

  14. Das, S., Lavoie, A.: The effects of feedback on human behavior in social media: An inverse reinforcement learning model. In: Proceedings of the 2014 International Conference on Autonomous Agents and Multi-agent Systems, pp. 653–660 (2014)

    Google Scholar 

  15. Dantas, A.P.R.R.S.: Inferring user preferences by analyzing their behavior on streaming platforms using inverse reinforcement learning (2022)

    Google Scholar 

  16. Luceri, L., Giordano, S., Ferrara, E.: Detecting troll behavior via inverse reinforcement learning: a case study of Russian trolls in the 2016 us election. In: Proceedings of the International AAAI Conference on Web and Social Media, vol. 14, pp. 417–427 (2020)

    Google Scholar 

  17. Likmeta, A., Metelli, A.M., Ramponi, G., Tirinzoni, A., Giuliani, M., Restelli, M.: Dealing with multiple experts and non-stationarity in inverse reinforcement learning: an application to real-life problems. Mach. Learn. 110, 2541–2576 (2021)

    Article  MathSciNet  Google Scholar 

  18. Wang, X., High, A., Wang, X., Zhao, K.: Predicting users’ continued engagement in online health communities from the quantity and quality of received support. J. Assoc. Inf. Sci. Technol. 72(6), 710–722 (2021)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China under Grants 72104261, 72201221, and 72274230; Central University of Finance and Economics under the Program for Innovation Research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dan Fan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhang, Y., Wang, X., Zuo, Z., Fan, D. (2024). User Behavior Analysis in Online Health Community Based on Inverse Reinforcement Learning. In: Tu, Y.P., Chi, M. (eds) E-Business. New Challenges and Opportunities for Digital-Enabled Intelligent Future. WHICEB 2024. Lecture Notes in Business Information Processing, vol 517. Springer, Cham. https://doi.org/10.1007/978-3-031-60324-2_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-60324-2_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-60326-6

  • Online ISBN: 978-3-031-60324-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation