Abstract
The goal of Touché is to foster and support the development of technologies for argument and causal retrieval and analysis. For the fourth time, we organize the Touché lab featuring four shared tasks: (a) argument retrieval for controversial topics, where participants retrieve web documents that contain high-quality argumentation and detect the argument stance, (b) causal retrieval, where participants retrieve documents that contain causal statements from a generic web crawl and detect the causal stance, (c) image retrieval for arguments, where participants retrieve images showing support or opposition to some stance from a focused web crawl, and (d) intra-multilingual multi-target stance classification, where participants detect the stance of comments on proposals from the multilingual participatory democracy platform CoFE. In this paper, we briefly summarize the results of Touché 2022 and describe the planned setup for the fourth lab edition at CLEF 2023.
L. Hemamou—Independent view, not influenced by Sanofi R &D France.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
‘touché’ is commonly “used to acknowledge a hit in fencing or the success or appropriateness of an argument, an accusation, or a witty point.” [https://merriam-webster.com/dictionary/touche].
- 2.
- 3.
- 4.
The value of k will depend on the number of result submissions and, thus, the annotation workload (nDCG@5 was used in the previous Touché editions).
- 5.
- 6.
German, English, Greek, French, Italian, and Hungarian.
- 7.
References
Ajzen, I.: The social psychology of decision making. In: Social Psychology: Handbook of Basic Principles, pp. 297–325 (1996)
Barriere, V., Balahur, A., Ravenet, B.: Debating europe: a multilingual multi-target stance classification dataset of online debates. In: Proceedings of the LREC 2022 Workshop on Natural Language Processing for Political Sciences, pp. 16–21 (2022)
Barriere, V., Jacquet, G., Hemamou, L.: CoFE: a new dataset of intra-multilingual multi-target stance classification from an online European participatory democracy platform. In: Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (AACL-IJCNLP), Taipei, Taiwan (2022)
Bevendorff, J., Stein, B., Hagen, M., Potthast, M.: Elastic ChatNoir: search engine for the ClueWeb and the common crawl. In: Pasi, G., Piwowarski, B., Azzopardi, L., Hanbury, A. (eds.) ECIR 2018. LNCS, vol. 10772, pp. 820–824. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-76941-7_83
Bondarenko, A., et al.: Overview of Touché 2020: argument retrieval. In: Working Notes of CLEF 2020 - Conference and Labs of the Evaluation Forum, Thessaloniki, Greece, 22–25 September 2020, CEUR Workshop Proceedings, vol. 2696. CEUR-WS.org (2020). http://ceur-ws.org/Vol-2696/paper_261.pdf
Bondarenko, A., et al.: Overview of Touché 2022: argument retrieval. In: Proceedings of the Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CEUR Workshop Proceedings, vol. 3180, pp. 2867–2903. CEUR-WS.org (2022). http://ceur-ws.org/Vol-3180/paper-247.pdf
Bondarenko, A., et al.: Overview of Touché 2021: argument retrieval. In: Proceedings of the Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum, CEUR Workshop Proceedings, vol. 2936, pp. 2258–2284. CEUR-WS.org (2021). http://ceur-ws.org/Vol-2936/paper-205.pdf
Bondarenko, A., et al.: CausalQA: a benchmark for causal question answering. In: Calzolari, N., et al. (eds.) 29th International Conference on Computational Linguistics (COLING 2022), pp. 3296–3308. International Committee on Computational Linguistics (2022). https://aclanthology.org/2022.coling-1.291
Chernodub, A., et al.: TARGER: neural argument mining at your fingertips. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, ACL 2019, pp. 195–200. ACL (2019). https://doi.org/10.18653/v1/p19-3031
Heindorf, S., Scholten, Y., Wachsmuth, H., Ngonga Ngomo, A.C., Potthast, M.: CauseNet: towards a causality graph extracted from the web. In: d’Aquin, M., et al. (eds.) 29th ACM International Conference on Information and Knowledge Management (CIKM 2020), pp. 3023–3030. ACM (2020). https://doi.org/10.1145/3340531.3412763
Kiesel, J., Potthast, M., Stein, B.: Dataset Touché22-Image-Retrieval-for-Arguments (2022). https://doi.org/10.5281/zenodo.6786948
Kiesel, J., Potthast, M., Stein, B.: Dataset Touché23-Image-Retrieval-for-Arguments (2023). https://doi.org/10.5281/zenodo.7497994
Overwijk, A., **ong, C., Callan, J.: ClueWeb22: 10 billion web documents with rich information. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2022, pp. 3360–3362. ACM (2022). https://doi.org/10.1145/3477495.3536321
Potthast, M., Gollub, T., Wiegmann, M., Stein, B.: TIRA integrated research architecture. In: Ferro, N., Peters, C. (eds.) Information Retrieval Evaluation in a Changing World. TIRS, vol. 41, pp. 123–160. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22948-1_5
Vamvas, J., Sennrich, R.: X-stance: a multilingual multi-target dataset for stance detection. In: Proceedings of the 5th Swiss Text Analytics Conference and the 16th Conference on Natural Language Processing, SwissText/KONVENS 2020. CEUR-WS.org (2020). http://ceur-ws.org/Vol-2624/paper9.pdf
Wachsmuth, H., et al.: Computational argumentation quality assessment in natural language. In: Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics (EACL), pp. 176–187. Association for Computational Linguistics (2017). https://doi.org/10.18653/v1/e17-1017
**e, X., et al.: Grid-based evaluation metrics for web image search. In: Liu, L., et al. (eds.) Proceedings of the 28th International World Wide Web Conference, WWW 2019, pp. 2103–2114. ACM (2019). https://doi.org/10.1145/3308558.3313514
Acknowledgments
This work has been partially supported by the Deutsche Forschungsgemeinschaft (DFG) in the project “ACQuA 2.0: Answering Comparative Questions with Arguments” (project 376430233) as part of the priority program “RATIO: Robust Argumentation Machines” (SPP 1999). V. Barriere’s work was funded by the National Center for Artificial Intelligence CENIA FB210017, Basal ANID.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Bondarenko, A. et al. (2023). Overview of Touché 2023: Argument and Causal Retrieval. In: Kamps, J., et al. Advances in Information Retrieval. ECIR 2023. Lecture Notes in Computer Science, vol 13982. Springer, Cham. https://doi.org/10.1007/978-3-031-28241-6_61
Download citation
DOI: https://doi.org/10.1007/978-3-031-28241-6_61
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-28240-9
Online ISBN: 978-3-031-28241-6
eBook Packages: Computer ScienceComputer Science (R0)