Hybrid Attention Knowledge Fusion Network for Automated Medical Code Assignment

  • Conference paper
  • First Online:
Bioinformatics Research and Applications (ISBRA 2024)

Part of the book series: Lecture Notes in Computer Science ((LNBI,volume 14954))

Included in the following conference series:

Abstract

Automated medical code assignment aims to allocate disease and procedure codes to patient's discharge summaries, which is crucial for health statistics, medical decision-making, and reimbursement. To alleviate the burden on manual coders and improve coding efficiency, several methods for automated code assignment have been proposed. However, challenges persist in automated medical code assignment due to knowledge gaps, the complexity and verbosity of clinical text, and class imbalance issue. In this study, we present a Hybrid Attention Knowledge Fusion Network (HAKFN) with the Transformer-based architecture to overcome the aforementioned challenges. We introduce structured tabular data from patient's electronic health records (EHRs) as additional auxiliary knowledge for the model and design a hybrid attention module to integrate clinical text with tabular data to enhance text representations. To mitigate class imbalance issue, we employ focal loss to rebalance the model's attention toward low-frequency and high-frequency codes. Results of the experiments demonstrate that our method achieves competitive performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Chiaravalloti, M.T., Guarasci, R., Lagani, V., Pasceri, E., Trunfio, R.: A coding support system for the ICD-9-CM standard. In: 2014 IEEE International Conference on Healthcare Informatics, pp. 71–78 (2014)

    Google Scholar 

  2. O'malley, K.J., Cook, K.F., Price, M.D., Wildes, K.R., Hurdle, J.F., Ashton, C.M.: Measuring diagnoses: ICD code accuracy. Health Serv. Res. 40(52), 1620–1639 (2005)

    Google Scholar 

  3. Sonabend, A., et al.: Automated ICD coding via unsupervised knowledge integration (UNITE). Int. J. Med. Informatics 139, 104135 (2020)

    Article  Google Scholar 

  4. Johnson, A.E., et al.: Mimic-iii, a freely accessible critical care database. Sci. Data 3(1), 1–9 (2016)

    Article  MathSciNet  Google Scholar 

  5. Liu, Y., Cheng, H., Klopfer, R., Gormley, M.R., Schaaf, T.: Effective convolutional attention network for multi-label clinical document classification. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 5941–5953 (2021)

    Google Scholar 

  6. Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)

    Google Scholar 

  7. Vu, T., Nguyen, D.Q., Nguyen, A.: A label attention model for ICD coding from clinical text. In: Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence, pp. 3335–3341 (2021)

    Google Scholar 

  8. Liu, L., Perez-Concha, O., Nguyen, A., Bennett, V., Jorm, L.: Hierarchical label-wise attention transformer model for explainable ICD coding. J. Biomed. Inform. 133, 104161 (2022)

    Article  Google Scholar 

  9. Mullenbach, J., Wiegreffe, S., Duke, J., Sun, J., Eisenstein, J.: Explainable prediction of medical codes from clinical text. In: 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2018, pp. 1101–1111. Association for Computational Linguistics (ACL) (2018)

    Google Scholar 

  10. **e, X., **ong, Y., Yu, P.S., Zhu, Y.: EHR coding with multi-scale feature attention and structured knowledge graph propagation. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp. 649–658 (2019)

    Google Scholar 

  11. Li, F., Yu, H.: ICD coding from clinical text using multi-filter residual convolutional neural network. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 8180–8187 (2020)

    Google Scholar 

  12. Li, X., Zhang, Y., Li, X., Wang, J., Lu, M.: NIDN: medical code assignment via note-code interaction denoising network. In: International Symposium on Bioinformatics Research and Applications, pp. 62–74 (2022)

    Google Scholar 

  13. Yuan, Z., Tan, C., Huang, S.: Code synonyms do matter: multiple synonyms matching network for automatic ICD coding. In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp. 808–814 (2022)

    Google Scholar 

  14. Luo, J., Wang, X., Wang, J., Chang, A., Wang, Y., Ma, F. CoRelation: Boosting Automatic ICD Coding Through Contextualized Code Relation Learning. ar**v preprint ar**v:2402.15700 (2024)

  15. Biswas, B., Pham, T.H., Zhang, P.: TransICD: transformer based code-wise attention model for explainable ICD coding. In: Artificial Intelligence in Medicine: 19th International Conference on Artificial Intelligence in Medicine, pp. 469–478 (2021)

    Google Scholar 

  16. Zhou, T., et al.: Automatic ICD coding via interactive shared representation networks with self-distillation mechanism. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. pp. 5948–5957 (2021)

    Google Scholar 

  17. Hou, W.H., Wang, X.K., Wang, Y. N., Wang, J.Q., **ao, F.: Modelling long medical documents and code associations for explainable automatic ICD coding. Expert Syst. Appl. 123519 (2024)

    Google Scholar 

  18. Liu, Z., Liu, X., Wen, Y., Zhao, G., **a, F., Yuan, X.: TreeMAN: tree-enhanced multimodal attention network for ICD coding. In: Proceedings of the 29th International Conference on Computational Linguistics. pp. 3054–3063 (2022)

    Google Scholar 

Download references

Acknowledgement

This work is supported by grant from the Natural Science Foundation of China (No. 62072070).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yijia Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, S., Li, X., Qu, W., Lin, H., Zhang, Y. (2024). Hybrid Attention Knowledge Fusion Network for Automated Medical Code Assignment. In: Peng, W., Cai, Z., Skums, P. (eds) Bioinformatics Research and Applications. ISBRA 2024. Lecture Notes in Computer Science(), vol 14954. Springer, Singapore. https://doi.org/10.1007/978-981-97-5128-0_24

Download citation

  • DOI: https://doi.org/10.1007/978-981-97-5128-0_24

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-97-5127-3

  • Online ISBN: 978-981-97-5128-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation