Using Co-word Network Community Detection and LDA Topic Modeling to Extract Topics in TED Talks

  • Conference paper
  • First Online:
HCI in Business, Government and Organizations (HCII 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14039))

Included in the following conference series:

  • 1234 Accesses

Abstract

Two topic detection techniques—co-word network analysis and topic modeling—were applied to extract topics in the Ted Talks. Ted Talks was chosen for its enormous impact worldwide and the rich descriptive data accompanying each talk that allow us to compare the topics resulting from different methods. The co-word network was built based on the “related_tags” field so that modularity analysis can be performed to classify the tags according to their co-occurrence patterns. Topic modeling was applied to the description field and the full-text transcript separately to detect the topics present in the free-text. The results of network modularity analysis revealed 13 interpretable topics consisting of closely knitted tags. Topic modeling generated 25 topics for the description and 40 for the transcript, respectively. Our results showed that both topic extraction methods were able to successfully identify the range of topics in the TED Talks. While the co-word network gave a broad overview and afforded visualization, the topic model revealed topics with greater granularity. We compared the semantics of the topics produced by different methods and discussed the methodological implications of our research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (France)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 67.40
Price includes VAT (France)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 84.39
Price includes VAT (France)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Callon, M., Courtial, J.P., Laville, F.: Co-word analysis as a tool for describing the network of interactions between basic and technological research: the case of polymer chemistry. Scientometrics 22(1), 155–205 (1991)

    Article  Google Scholar 

  2. Rip, A., Courtial, J.P.: Co-word maps of biotechnology: an example of cognitive scientometrics. Scientometrics 6(6), 381–400 (1984)

    Article  Google Scholar 

  3. Leydesdorff, L., Nerghes, A.: Co-word maps and topic modeling: a comparison using small and medium-sized corpora (N < 1,000). J. Am. Soc. Inf. Sci. 68(4), 1024–1035 (2017)

    Google Scholar 

  4. Ding, Y., Chowdhury, G.G., Foo, S.: Bibliometric cartography of information retrieval research by using co-word analysis. Inform. Process. Manag. 37(6), 817–842 (2001)

    Article  MATH  Google Scholar 

  5. Hu, J., Zhang, Y.: Research patterns and trends of recommendation system in China using co-word analysis. Inform. Process. Manag. 51(4), 329–339 (2015)

    Article  Google Scholar 

  6. Tang, M.C., Cheng, Y.J., Chen, K.H.: A longitudinal study of intellectual cohesion in digital humanities using bibliometric analyses. Scientometrics 113(2), 985–1008 (2017)

    Article  Google Scholar 

  7. Tang, M.C., Teng, W., Lin, M.: Determining the critical thresholds for co-word network based on the theory of percolation transition: a case study in Buddhist studies. J. Documentation 76(2), 462–483 (2019)

    Article  Google Scholar 

  8. Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J. Mach. Learn. Res. 3(Jan), 993–1022 (2003)

    MATH  Google Scholar 

  9. Blei, D.M., Lafferty, J.D.: Dynamic topic models. In: Proceedings of the 23rd international conference on Machine learning, pp. 113–120, Association for Computing Machinery, New York (2006)

    Google Scholar 

  10. Fan, W.M., Jeng, W., Tang, M.C.: Using data citation to define a knowledge domain: a case study of the Add-Health dataset. J. Assoc. Inform. Sci. Technol. 74(1), 81–98 (2023)

    Article  Google Scholar 

  11. Suominen, A., Toivanen, H.: Map of science with topic modeling: comparison of unsupervised learning and human-assigned subject classification. J. Am. Soc. Inf. Sci. 67(10), 2464–2476 (2016)

    Google Scholar 

  12. Callon, M., Law, J., Rip, A.: Qualitative scientometrics. In: Callon, M., Law, J., Rip, A. (eds.) Map** the Dynamics of Science and Technology, pp. 103–123. Palgrave Macmillan, London (1986)

    Chapter  Google Scholar 

  13. Blondel, V.D., Guillaume, J.L., Lambiotte, R., Lefebvre, E.: Fast unfolding of communities in large networks. J. Stat. Mech.: Theory Exp. 2008(10), 10008 (2008)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Muh-Chyun Tang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hung, LT., Tang, MC., Lin, SC. (2023). Using Co-word Network Community Detection and LDA Topic Modeling to Extract Topics in TED Talks. In: Nah, F., Siau, K. (eds) HCI in Business, Government and Organizations. HCII 2023. Lecture Notes in Computer Science, vol 14039. Springer, Cham. https://doi.org/10.1007/978-3-031-36049-7_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-36049-7_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-36048-0

  • Online ISBN: 978-3-031-36049-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation