-
Article
Open AccessInteractive multimodal video search: an extended post-evaluation for the VBS 2022 competition
CLIP-based text-to-image retrieval has proven to be very effective at the interactive video retrieval competition Video Browser Showdown 2022, where all three top-scoring teams had implemented a variant of a CLIP...
-
Chapter and Conference Paper
Mining Landmark Images for Scene Reconstruction from Weakly Annotated Video Collections
Many XR productions require reconstructions of landmarks such as buildings or public spaces. Shooting content on demand is often not feasible, thus tap** into audiovisual archives for images and videos as in...
-
Chapter and Conference Paper
Few-Shot Object Detection as a Service: Facilitating Training and Deployment for Domain Experts
We propose a service-based approach for training few-shot object detectors and running inference with these models. This eliminates the need to write code or execute scripts, thus enabling domain experts to tr...
-
Article
Interactive video retrieval in the age of effective joint embedding deep models: lessons from the 11th VBS
This paper presents findings of the eleventh Video Browser Showdown competition, where sixteen teams competed in known-item and ad-hoc search tasks. Many of the teams utilized state-of-the-art video retrieval ...
-
Chapter and Conference Paper
Taylor – Impersonation of AI for Audiovisual Content Documentation and Search
While AI-based audiovisual analysis tools have without doubt made huge progress, integrating them in media production and archiving workflows is still challenging, as the provided annotations may not match nee...
-
Chapter and Conference Paper
People@Places and ToDY: Two Datasets for Scene Classification in Media Production and Archiving
In order to support common annotation tasks in visual media production and archiving, we propose two datasets which cover the annotation of the bustle of a scene (i.e., populated to unpopulated), the cinematog...
-
Article
Interactive video retrieval evaluation at a distance: comparing sixteen interactive video search systems in a remote setting at the 10th Video Browser Showdown
The Video Browser Showdown addresses difficult video search challenges through an annual interactive evaluation campaign attracting research teams focusing on interactive video retrieval. The campaign aims to ...
-
Chapter and Conference Paper
Passive Guidance for Offroad-Vehicles
In contrast to commercial automated driving, where systems are usually able to use infrastructure such as high-definition maps and GNSS as well as active sensors such as Lidar or Radar, in unstructured offroad...
-
Chapter and Conference Paper
AI for the Media Industry: Application Potential and Automation Levels
Tools based on artificial intelligence (AI) are increasingly used in the media industry, addressing a potentially wide range of application areas. Based on a survey involving media professionals and technology...
-
Chapter and Conference Paper
Making Few-Shot Object Detection Simpler and Less Frustrating
Few-shot object detection is useful in order to extend object detection capabilities in media production and archiving applications with specific object classes of interest for a particular organization or pro...
-
Chapter and Conference Paper
A Task Category Space for User-Centric Comparative Multimedia Search Evaluations
In the last decade, user-centric video search competitions have facilitated the evolution of interactive video search systems. So far, these competitions focused on a small number of search task categories, wi...
-
Chapter and Conference Paper
Considering Human Perception and Memory in Interactive Multimedia Retrieval Evaluations
Experimental evaluations dealing with visual known-item search tasks, where real users look for previously observed and memorized scenes in a given video collection, represent a challenging methodological prob...
-
Chapter and Conference Paper
Multimedia Analytics Challenges and Opportunities for Creating Interactive Radio Content
The emergence of audio streaming services and evolved listening habits notwithstanding, broadcast radio is still a popular medium that plays an important role in contemporary users’ media consumption mix. Whil...
-
Chapter and Conference Paper
Face Swap** for Solving Collateral Privacy Issues in Multimedia Analytics
A wide range of components of multimedia analytics systems relies on visual content that is used for supervised (e.g., classification) and unsupervised (e.g., clustering) machine learning methods. This content...
-
Chapter and Conference Paper
Incremental Training for Face Recognition
Many applications require the identification of persons in video. However, the set of persons of interest is not always known in advance, e.g., in applications for media production and archiving. Additional tr...
-
Chapter and Conference Paper
Evaluating Data Quality in Europeana: Metrics for Multilinguality
Europeana.eu aggregates metadata describing more than 50 million cultural heritage objects from libraries, museums, archives and audiovisual archives across Europe. The need for quality of metadata is particul...
-
Chapter and Conference Paper
On the Traceability of Results from Deep Learning-Based Cloud Services
Deep learning-based approaches have become an important method for media content analysis, and are useful tools for multimedia analytics, as they enable organising and visualising multimedia content items. How...
-
Chapter and Conference Paper
What Is the Role of Similarity for Known-Item Search at Video Browser Showdown?
Across many domains, machine learning approaches start to compete with human experts in tasks originally considered as very difficult for automation. However, effective retrieval of general video shots still r...
-
Article
Open AccessInteractive video search tools: a detailed analysis of the video browser showdown 2015
Interactive video retrieval tools developed over the past few years are emerging as powerful alternatives to automatic retrieval approaches by giving the user more control as well as more responsibilities. Cur...
-
Chapter and Conference Paper
Compressing Visual Descriptors of Image Sequences
In recent years, there has been significant progress in develo** more compact visual descriptors, typically by aggregating local descriptors. However, all these methods are descriptors for still images, and ...
