Neural Topic Modeling of Psychotherapy Sessions

  • Chapter
  • First Online:
Artificial Intelligence for Personalized Medicine (W3PHAI 2023)

Part of the book series: Studies in Computational Intelligence ((SCI,volume 1106))

Included in the following conference series:

Abstract

In this work, we compare different neural topic modeling methods in learning the topical propensities of different psychiatric conditions from the psychotherapy session transcripts parsed from speech recordings. We also incorporate temporal modeling to put this additional interpretability to action by parsing out topic similarities as a time series in a turn-level resolution. We believe this topic modeling framework can offer interpretable insights for the therapist to optimally decide his or her strategy and improve psychotherapy effectiveness.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://alexanderstreet.com/products/counseling-and-psychotherapy-transcripts-series.

  2. 2.

    https://github.com/zll17/Neural_Topic_Models.

  3. 3.

    https://github.com/RaRe-Technologies/gensim.

References

  1. R. Ahmad, D. Siemon, U. Gnewuch, S. Robra-Bissantz, Designing personality-adaptive conversational agents for mental health care. Inf. Syst. Front. 1–21 (2022)

    Google Scholar 

  2. J. Chang, S. Gerrish, C. Wang, J. Boyd-Graber, D. Blei, Reading tea leaves: how humans interpret topic models. NIPS 22 (2009)

    Google Scholar 

  3. A.B. Dieng, F.J. Ruiz, D.M. Blei, Topic modeling in embedding spaces. Trans. Assoc. Comput. Linguist. 8, 439–453 (2020)

    Article  Google Scholar 

  4. J.T.S. Li, C.P. Lee, W.K. Tang, Changes in mental health among psychiatric patients during the covid-19 pandemic in Hong Kong-a cross-sectional study. Int. J. Environ. Res. Public Health 19(3), 1181 (2022)

    Article  Google Scholar 

  5. B. Lin, Computational inference in cognitive science: operational, societal and ethical considerations (2022). ar**v:2210.13526

  6. B. Lin, Knowledge management system with NLP-assisted annotations: a brief survey and outlook, in CIKM Workshops (2022)

    Google Scholar 

  7. B. Lin, Personality effect on psychotherapy outcome: a predictive natural language processing framework (2022)

    Google Scholar 

  8. B. Lin, Reinforcement learning and bandits for speech and language processing: tutorial, review and outlook (2022). ar**v:2210.13623

  9. B. Lin, D. Bouneffouf, G. Cecchi, Split Q Learning: Reinforcement Learning with Two-Stream Rewards, in Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19. International Joint Conferences on Artificial Intelligence Organization (AAAI Press, 2019). pp. 6448–6449. https://doi.org/10.24963/ijcai.2019/913

  10. B. Lin, D. Bouneffouf, G. Cecchi, Predicting human decision making in psychological tasks with recurrent neural networks. PLoS ONE 17(5), e0267907 (2022)

    Article  Google Scholar 

  11. B. Lin, D. Bouneffouf, G. Cecchi, Predicting human decision making with lstm, in 2022 International Joint Conference on Neural Networks (IJCNN) (IEEE, 2022)

    Google Scholar 

  12. B. Lin, G. Cecchi, D. Bouneffouf, Supervisorbot: Nlp-annotated real-time recommendations of psychotherapy treatment strategies with deep reinforcement learning (2022). ar**v:2208.13077

  13. B. Lin, G. Cecchi, D. Bouneffouf, Working alliance transformer for psychotherapy dialogue classification (2022). ar**v:2210.15603

  14. B. Lin, G. Cecchi, D. Bouneffouf, Deep annotation of therapeutic working alliance in psychotherapy, in International Workshop on Health Intelligence (Springer, 2023)

    Google Scholar 

  15. B. Lin, G. Cecchi, D. Bouneffouf, J. Reinen, I. Rish, A story of two streams: Reinforcement learning models from human behavior and neuropsychiatry, in Proceedings of the 19th International Conference on Autonomous Agents and MultiAgent Systems (2020), pp. 744–752

    Google Scholar 

  16. B. Lin, G. Cecchi, D. Bouneffouf, J. Reinen, I. Rish, Unified models of human behavioral agents in bandits, contextual bandits and RL (2020). ar**v:2005.04544

  17. B. Lin, G. Cecchi, D. Bouneffouf, J. Reinen, I. Rish, Models of human behavioral agents in bandits, contextual bandits and RL, in International Workshop on Human Brain and Artificial Intelligence (Springer, 2021), pp. 14–33.

    Google Scholar 

  18. Y. Miao, E. Grefenstette, P. Blunsom, Discovering discrete latent topics with neural variational inference, in International Conference on Machine Learning (PMLR, 2017), pp. 2410–2419

    Google Scholar 

  19. Y. Miao, L. Yu, P. Blunsom, Neural variational inference for text processing, in International Conference on Machine Learning (PMLR, 2016), pp. 1727–1736.

    Google Scholar 

  20. T. Mikolov, I. Sutskever, K. Chen, G.S. Corrado, J. Dean, Distributed representations of words and phrases and their compositionality. Adv. Neural Inf. Process. Syst. 26 (2013)

    Google Scholar 

  21. D. Mimno, H. Wallach, E. Talley, M. Leenders, A. McCallum, Optimizing semantic coherence in topic models, in Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing (2011), pp. 262–272

    Google Scholar 

  22. A.M. Moe, E. Llamocca, H.M. Wastler, D.L. Steelesmith, G. Brock, J.A. Bridge, C.A. Fontanella, Risk factors for deliberate self-harm and suicide among adolescents and young adults with first-episode psychosis. Schizophr. Bull. 48(2), 414–424 (2022)

    Article  Google Scholar 

  23. F. Nan, R. Ding, R. Nallapati, B. **ang, Topic modeling with wasserstein autoencoders, in Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (2019), pp. 6345–6381

    Google Scholar 

  24. R. Rehurek, P. Sojka et al., Gensim-statistical semantics in python. Retrieved from genism.org (2011)

    Google Scholar 

  25. P. Resnik, W. Armstrong, L. Claudino, T. Nguyen, V.A. Nguyen, J. Boyd-Graber, Beyond lda: exploring supervised topic modeling for depression-related language in twitter, in Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality (2015), pp. 99–107

    Google Scholar 

  26. N. Rezaii, P. Wolff, B.H. Price, Natural language processing in psychiatry: the promises and perils of a transformative approach. Br. J. Psych. 1–3 (2022)

    Google Scholar 

  27. M. Röder, A. Both, A. Hinneburg, Exploring the space of topic coherence measures, in Proceedings of the Eighth ACM International Conference on Web Search and Data Mining (2015), pp. 399–408

    Google Scholar 

  28. H.Y. Shum, X.D. He, D. Li, From eliza to xiaoice: challenges and opportunities with social chatbots. Front. Inf. Technol. Electron. Eng. 19(1), 10–26 (2018)

    Google Scholar 

  29. R. Wang, X. Hu, D. Zhou, Y. He, Y. **ong, C. Ye, H. Xu, Neural topic modeling with bidirectional adversarial training, in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (2020), pp. 340–350

    Google Scholar 

  30. M.T. ZEMČÍK, A brief history of chatbots. DEStech Trans. Comput. Sci. Eng. 10 (2019)

    Google Scholar 

  31. Q.T. Zeng, D. Redd, T. Rindflesch, J. Nebeker, Synonym, topic model and predicate-based query expansion for retrieving clinical documents, in AMIA Annual Symposium Proceedings, vol. 2012 (American Medical Informatics Association, 2012), p. 1050

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Baihan Lin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Lin, B., Bouneffouf, D., Cecchi, G., Tejwani, R. (2023). Neural Topic Modeling of Psychotherapy Sessions. In: Shaban-Nejad, A., Michalowski, M., Bianco, S. (eds) Artificial Intelligence for Personalized Medicine. W3PHAI 2023. Studies in Computational Intelligence, vol 1106. Springer, Cham. https://doi.org/10.1007/978-3-031-36938-4_16

Download citation

Publish with us

Policies and ethics

Navigation