A Contextualized Government Service Chatbot for Individuals with limited Information Literacy

  • Conference paper
  • First Online:
Wisdom, Well-Being, Win-Win (iConference 2024)

Abstract

Improving the Q&A ability of government service chatbots (GSCs) has become an important issue. In practice, a large number of users with poor information literacy often pose vague questions, which makes it challenging for GSCs to comprehend their inquiries within a specific context. In order to enhance contextualization, this study has constructed a multi-turn dialogue model that incorporates R-GCN and fuzzy logic to base on the “question-answer-context” matching process. To obtain more accurate context, we propose a re-question mechanism to further press for contextual details. Additionally, we introduce the sub-graph matching mechanism of fuzzy logic and R-GCN to improve the accuracy of implicitly representation of Chinese logic in the contextualized matching process. This mechanism allows us to prune the context-irrelevant parts in the “answer” and obtain more complete context information. We collected over 300,000 words of real cases as the test-set. The results of the experiments show that this model can significantly improve the contextualized reasoning ability of GSCs in a more humanized way. The innovative response generation method in this research, which utilizes “question-answer-context” matching, is more suitable for complex scenarios where the user may not be articulate. It helps to lower the barrier for accessing government services and provides more user-friendly assistance to individuals with limited information literacy.

Z. Lian and H. Meiyin—Contributed equally to this work, should be considered co-first authors.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    In fuzzy logic, a membership function is employed for characterizing the extent to which an element belongs to a specific fuzzy set. It assigns a membership degree value, ranging from 0 to 1, to the element, facilitating the management of imprecise information and the execution of fuzzy reasoning.

References

  1. Fui-Hoon Nah, F., Zheng, R., Cai, J., Siau, K., Chen, L.: Generative AI and ChatGPT: applications, challenges, and AI-human collaboration. J. Inf. Technol. Case Appl. Res. 25(3), 277–304 (2023)

    Google Scholar 

  2. Goyal, P., Pandey, S., Jain, K.: Deep Learning for Natural Language Processing, p. 19. Apress, New York (2018)

    Google Scholar 

  3. Aoki, N.: An experimental study of public trust in AI chatbots in the public sector. Gov. Inf. Q. 37(4), 101490 (2020)

    Article  Google Scholar 

  4. Ju, J., Meng, Q., Sun, F., Liu, L., Singh, S.: Citizen preferences and government chatbot social characteristics: evidence from a discrete choice experiment. Gov. Inf. Q. 101785 (2023)

    Google Scholar 

  5. Turban, E., et al.: Innovative EC systems: from E-Government to E-Learning, E-Health, sharing economy, and P2P commerce. In: Electronic Commerce 2018: A Managerial and Social Networks Perspective, pp. 167–201 (2018)

    Google Scholar 

  6. Wang, Y., Zhang, N., Zhao, X.: Understanding the determinants in the different government AI adoption stages: evidence of local government chatbots in China. Soc. Sci. Comput. Rev. 40(2), 534–554 (2022)

    Article  Google Scholar 

  7. Chaves, A.P., Gerosa, M.A.: How should my chatbot interact? A survey on social characteristics in human–chatbot interaction design. Int. J. Hum.-Comput. Interact. 37(8), 729–758 (2021)

    Article  Google Scholar 

  8. Dyke, G., Howley, I., Adamson, D., Kumar, R., Rosé, C.P.: Towards academically productive talk supported by conversational agents. Productive Multivocality in the Analysis of Group Interactions, pp. 459–476 (2013)

    Google Scholar 

  9. Wang, F.: Social capital or non-human sources? A cross-context study on information source selection of migrant farmer workers. J. Inf. Sci. 49(5), 1358–1374 (2021, 2023)

    Google Scholar 

  10. Jain, M., Kumar, P., Kota, R., Patel, S.N.: Evaluating and informing the design of chatbots. In: Proceedings of the 2018 Designing Interactive Systems Conference, pp. 895–906, June 2018

    Google Scholar 

  11. Borji, A.: A categorical archive of ChatGPT failures. ar**v preprint ar**v:2302.03494 (2023)

  12. Dale, R.: The return of the chatbots. Nat. Lang. Eng. 22(5), 811–817 (2016)

    Article  Google Scholar 

  13. Yang, Z., Choi, J.D.: FriendsQA: open-domain question answering on TV show transcripts. In: Proceedings of the 20th Annual SIGdial Meeting on Discourse and Dialogue, pp. 188–197, September 2019

    Google Scholar 

  14. Li, C., Choi, J.D.: Transformers to learn hierarchical contexts in multiparty dialogue for span-based question answering. ar**v preprint ar**v:2004.03561 (2020)

  15. Liu, Q., Chen, B., Lou, J. G., Zhou, B., & Zhang, D.: Incomplete utterance rewriting as semantic segmentation. ar**v preprint ar**v:2009.13166 (2020)

  16. Zhou, X., et al.: Multi-view response selection for human-computer conversation. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 372–381, November 2016

    Google Scholar 

  17. Yuan, C., et al.: Multi-hop selector network for multi-turn response selection in retrieval-based chatbots. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 111–120, November 2019

    Google Scholar 

  18. Yang, Z., Xu, W., Chen, R.: A deep learning-based multi-turn conversation modeling for diagnostic Q&A document recommendation. Inf. Process. Manag. 58(3), 102485 (2021)

    Article  Google Scholar 

  19. Xu, Y., Zhao, H., Zhang, Z.: Topic-aware multi-turn dialogue modeling. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 16, pp. 14176–14184, May 2021

    Google Scholar 

  20. Ding, M., Zhou, C., Chen, Q., Yang, H., Tang, J.: Cognitive graph for multi-hop reading comprehension at scale. ar**v preprint ar**v:1905.05460 (2019)

  21. Qin, L., **e, T., Che, W., Liu, T.: A survey on spoken language understanding: recent advances and new frontiers. ar**v preprint ar**v:2103.03095 (2021)

  22. Zhang, Y., et al.: DialoGPT: large-scale generative pre-training for conversational response generation. ar**v preprint ar**v:1911.00536 (2019)

  23. Lowe, R., Pow, N., Serban, I., Pineau, J.: The ubuntu dialogue corpus: a large dataset for research in unstructured multi-turn dialogue systems. ar**v preprint ar**v:1506.08909 (2015)

  24. Shang, L., Lu, Z., Li, H.: Neural responding machine for short-text conversation. ar**v preprint ar**v:1503.02364 (2015)

  25. Wu, Y., Wu, W., **ng, C., Zhou, M., Li, Z.: Sequential matching network: a new architecture for multi-turn response selection in retrieval-based chatbots. ar**v preprint ar**v:1612.01627 (2016)

  26. Zhou, H., Huang, M., Zhang, T., Zhu, X., Liu, B.: Emotional chatting machine: emotional conversation generation with internal and external memory. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32, no. 1, April 2018

    Google Scholar 

  27. Zhang, D., Yang, Z., Meng, F., Chen, X., Zhou, J.: TSAM: a two-stream attention model for causal emotion entailment. ar**v preprint ar**v:2203.00819 (2022)

  28. Peng, W., Hu, Y., **ng, L., **e, Y., Sun, Y., Li, Y.: Control globally, understand locally: a global-to-local hierarchical graph network for emotional support conversation. ar**v preprint ar**v:2204.12749 (2022)

  29. Papineni, K., Roukos, S., Ward, T., Zhu, W.J.: Bleu: a method for automatic evaluation of machine translation. In: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pp. 311–318, July 2002

    Google Scholar 

  30. Li, J., Galley, M., Brockett, C., Gao, J., Dolan, B.: A diversity-promoting objective function for neural conversation models. ar**v preprint ar**v:1510.03055 (2015)

  31. Lin, C.Y.: Rouge: a package for automatic evaluation of summaries. In: Text Summarization Branches Out, pp. 74–81, July 2004

    Google Scholar 

  32. Zhao, L., Xu, W., Gao, S., Guo, J.: Utilizing graph neural networks to improve dialogue-based relation extraction. Neurocomputing 456, 299–311 (2021)

    Article  Google Scholar 

  33. Wu, S., Tang, Y., Zhu, Y., Wang, L., **e, X., Tan, T.: Session-based recommendation with graph neural networks. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, no. 01, pp. 346–353, July 2019

    Google Scholar 

  34. Hu, S., Zou, L., Yu, J.X., Wang, H., Zhao, D.: Answering natural language questions by subgraph matching over knowledge graphs. IEEE Trans. Knowl. Data Eng. 30(5), 824–837 (2017)

    Article  Google Scholar 

  35. Herd, P., DeLeire, T., Harvey, H., Moynihan, D.P.: Shifting administrative burden to the state: a case study of medicaid take-up, 73, S69 (2013)

    Google Scholar 

  36. Moynihan, D.P., Herd, P., Ribgy, E.: Policymaking by other means: do states use administrative barriers to limit access to Medicaid? Adm. Soc. 48(4), 497–524 (2016)

    Article  Google Scholar 

  37. Bertot, J., Estevez, E., Janowski, T.: Universal and contextualized public services: digital public service innovation framework. Gov. Inf. Q. 33(2), 211–222 (2016)

    Article  Google Scholar 

  38. Kahn, R.L., Katz, D., Gutek, B.: Bureaucratic encounters—an evaluation of government services. J. Appl. Behav. Sci. 12(2), 178–198 (1976)

    Article  Google Scholar 

  39. Moynihan, D., Herd, P., Harvey, H.: Administrative burden: learning, psychological, and compliance costs in citizen-state interactions. J. Publ. Adm. Res. Theory 25(1), 43–69 (2015)

    Article  Google Scholar 

  40. Burden, B.C., Canon, D.T., Mayer, K.R., Moynihan, D.P.: The effect of administrative burden on bureaucratic perception of policies: evidence from election administration. Publ. Adm. Rev. 72(5), 741–751 (2012)

    Article  Google Scholar 

  41. Arendsen, R., Peters, O., Ter Hedde, M., Van Dijk, J.: Does e-government reduce the administrative burden of businesses? An assessment of business-to-government systems usage in the Netherlands. Gov. Inf. Q. 31(1), 160–169 (2014)

    Article  Google Scholar 

Download references

Acknowledgments

The authors gratefully acknowledge the financial support provided by the National Social Science Foundation of China (20ZDA039), the National Science Foundation of China ("Multi-dimensional Analysis of Policy Driven by Big Data", 72293571), Ministry of Education in China (MOE) Project of Humanities and Social Sciences (Project No. 23YJC630107).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhixuan Lian .

Editor information

Editors and Affiliations

Ethics declarations

We declare that the paper is no conflict of interest for all authors.

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lian, Z., Huang, M., Wang, F. (2024). A Contextualized Government Service Chatbot for Individuals with limited Information Literacy. In: Sserwanga, I., et al. Wisdom, Well-Being, Win-Win. iConference 2024. Lecture Notes in Computer Science, vol 14596. Springer, Cham. https://doi.org/10.1007/978-3-031-57850-2_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-57850-2_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-57849-6

  • Online ISBN: 978-3-031-57850-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation