-
Chapter and Conference Paper
Advancing Multimedia Retrieval in Medical, Social Media and Content Recommendation Applications with ImageCLEF 2024
The ImageCLEF evaluation campaign was integrated with CLEF (Conference and Labs of the Evaluation Forum) for more than 20 years and represents a Multimedia Retrieval challenge aimed at evaluating the technolog...
-
Chapter and Conference Paper
The First International Workshop on Open Web Search (WOWS)
We organize the first international Workshop on Open Web Search (WOWS) at ECIR 2024 with two calls for contributions. The first call targets scientific contributions on cooperative search engine development.Th...
-
Chapter and Conference Paper
Overview of Touché 2024: Argumentation Systems
Decision-making and opinion-forming are everyday tasks that involve weighing pro and con arguments. The goal of Touché is to foster the development of support-technologies for decision-making and opinion-formi...
-
Chapter and Conference Paper
Overview of PAN 2024: Multi-author Writing Style Analysis, Multilingual Text Detoxification, Oppositional Thinking Analysis, and Generative AI Authorship Verification
The paper gives a brief overview of the four shared tasks organized at the PAN 2024 lab on digital text forensics and stylometry to be hosted at CLEF 2024. The goal of the PAN lab is to advance the state-of-th...
-
Chapter and Conference Paper
Is Google Getting Worse? A Longitudinal Investigation of SEO Spam in Search Engines
Many users of web search engines have been complaining in recent years about the supposedly decreasing quality of search results. This is often attributed to an increasing amount of search-engine-optimized but...
-
Chapter and Conference Paper
Analyzing Adversarial Attacks on Sequence-to-Sequence Relevance Models
Modern sequence-to-sequence relevance models like monoT5 can effectively capture complex textual interactions between queries and documents through cross-encoding. However, the use of natural language tokens i...
-
Chapter and Conference Paper
The Open Web Index
Only few search engines index the Web at scale. Third parties who want to develop downstream applications based on web search fully depend on the terms and conditions of the few vendors. The public availabilit...
-
Chapter and Conference Paper
Zero-Shot Generative Large Language Models for Systematic Review Screening Automation
Systematic reviews are crucial for evidence-based medicine as they comprehensively analyse published research findings on specific questions. Conducting such reviews is often resource- and time-intensive, espe...
-
Article
Open AccessA diachronic perspective on citation latency in Wikipedia articles on CRISPR/Cas-9: an exploratory case study
This paper analyzes Wikipedia’s representation of the Nobel Prize winning CRISPR/Cas9 technology, a method for gene editing. We propose and evaluate different heuristics to match publications from several publ...
-
Article
Open AccessA large dataset of scientific text reuse in Open-Access publications
We present the Webis-STEREO-21 dataset, a massive collection of Scientific Text Reuse in Open-access publications. It contains 91 million cases of reused text passages found in 4.2 million unique open-access publ...
-
Chapter and Conference Paper
Dynamic Exploratory Search for the Information Retrieval Anthology
This paper presents dynamic exploratory search technology for the analysis of scientific corpora. The unique dynamic features of the system allow users to analyze quantitative corpus statistics beyond document...
-
Chapter and Conference Paper
Overview of PAN 2023: Authorship Verification, Multi-author Writing Style Analysis, Profiling Cryptocurrency Influencers, and Trigger Detection
The paper gives a brief overview of the four shared tasks organized at the PAN 2023 lab on digital text forensics and stylometry to be hosted at the CLEF 2023 conference. The general goal of the PAN lab is to ...
-
Chapter and Conference Paper
Continuous Integration for Reproducible Shared Tasks with TIRA.io
A major obstacle to the long-term impact of most shared tasks is their lack of reproducibility. Often only the test collections and the papers of the organizers and participants are published. Third parties wh...
-
Chapter and Conference Paper
Overview of Touché 2023: Argument and Causal Retrieval
The goal of Touché is to foster and support the development of technologies for argument and causal retrieval and analysis. For the fourth time, we organize the Touché lab featuring four shared tasks: (a) argu...
-
Chapter and Conference Paper
Bootstrapped nDCG Estimation in the Presence of Unjudged Documents
Retrieval studies often reuse TREC collections after the corresponding tracks have passed. Yet, a fair evaluation of new systems that retrieve documents outside the original judgment pool is not straightforwar...
-
Chapter and Conference Paper
Overview of Touché 2023: Argument and Causal Retrieval
This paper is a condensed overview of Touché: the fourth edition of the lab on argument and causal retrieval that was held at CLEF 2023. With the goal to create a collaborative platform for research on computa...
-
Chapter and Conference Paper
Overview of PAN 2023: Authorship Verification, Multi-Author Writing Style Analysis, Profiling Cryptocurrency Influencers, and Trigger Detection
The paper gives a brief overview of three shared tasks which have been organized at the PAN 2023 lab on digital text forensics and stylometry hosted at the CLEF 2023 conference. The tasks include authorship ve...
-
Chapter and Conference Paper
Overview of Touché 2022: Argument Retrieval
The goal of the Touché lab on argument retrieval is to foster and support the development of technologies for argument mining and argument analysis. In the third edition of Touché, we organize three shared tas...
-
Chapter and Conference Paper
Visual Web Archive Quality Assessment
The large size of today’s web archives makes it impossible to manually assess the quality of each archived web page, i.e., to check whether a page can be reproduced faithfully from an archive. For automated we...
-
Chapter and Conference Paper
Overview of PAN 2022: Authorship Verification, Profiling Irony and Stereotype Spreaders, Style Change Detection, and Trigger Detection
The paper gives a brief overview of the four shared tasks to be organized at the PAN 2022 lab on digital text forensics and stylometry hosted at the CLEF 2022 conference. The tasks include authorship verificat...
