Search
Search Results
-
Multimodal metadata assignment for cultural heritage artifacts
We develop a multimodal classifier for the cultural heritage domain using a late fusion approach and introduce a novel dataset. The three modalities...
-
Stakeholder perspectives on the use of VoiceThread as a multimodal alternative to conventional discussion board in distance education
This pilot study explores and documents online students’ and their lecturer’s debut experiences of utilising VoiceThread (VT), a digital multimodal...
-
Gesture retrieval and its application to the study of multimodal communication
Comprehending communication is dependent on analyzing the different modalities of conversation, including audio, visual, and others. This is a...
-
GenSpecVidOnt: a reference ontology for knowledge based video analytics with multimodal genre detection
Video analytics refers to the process of automatically analysing a video for spatial and temporal events. Effective video analytics require...
-
Multimodal Pneumatic Control System for Soft Robot
In order to satisfy the requirements of output channels, drive modes and pressure detection for the complex motion of soft pneumatic robots, a...
-
Pneumatic and acoustic suit: multimodal haptic suit for enhanced virtual reality simulation
A haptic device provides users with physical feedback to enhance their experience in virtual reality (VR). We developed a multimodal haptic suit,...
-
Environment awareness, multimodal interaction, and intelligent assistance in industrial augmented reality solutions with deep learning
Augmented reality is increasingly used in various fields, especially industrial applications. Although augmented reality devices’ characteristics and...
-
Deep reinforcement learning of passenger behavior in multimodal journey planning with proportional fairness
Multimodal transportation systems require an effective journey planner to allocate multiple passengers to transport operators. One example is...
-
A Roadmap for Technological Innovation in Multimodal Communication Research
Multimodal communication research focuses on how different means of signalling coordinate to communicate effectively. This line of research is...
-
Analyzing Facial Expressions and Body Gestures Through Multimodal Metaphors: An Intelligent E-feedback Interface
Humans develop facial expressions to transmit a variety of meanings in a variety of settings. The facial expression is in charge of transmitting not...
-
Pseudo-haptic Feedback Design for Virtual Activities in Human Computer Interface
Digital world such as Metaverse requires a fully multimodal integrated cognitive interface to provide realistic and immersive interaction that boosts...
-
Multimodal AI: Creating a Podcast Visualizer with Whisper and DALL·E 3
Now let’s introduce a new term: multimodal AI. In the most simplest of terms, generative AI models can create content in 1 of 4 formats:
-
The effects of immersive virtual reality field trips upon student academic achievement, cognitive load, and multimodal presence in a social studies educational context
There is increasing educational interest in immersive virtual reality (IVR) applications which aid student learning and performance. However, few...
-
Human Interface and the Management of Information Thematic Area, HIMI 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23–28, 2023, Proceedings, Part II
This two-volume set LNCS 14015 - 14016 constitutes the thoroughly refereed proceedings of the thematic area Human Interface and the Management of...
-
Sensory Technolinguistics: On Mechanisms of Transmitting Multimodal Messages in Perceptual-Cognitive Interfaces
AbstractAn approach to implementing perceptual-cognitive interfaces (PCIs) is presented in the context of the synchronous transmission of speech...
-
Evaluating Multimodal Behavior Schemas with VoxWorld
The ability to understand and model human-object interactions is becoming increasingly important in advancing the field of human-computer interaction...
-
A literature survey on multimodal and multilingual automatic hate speech identification
Social media is a more common and powerful platform for communication to share views about any topic or article, which consequently leads to...
-
ISRE-Framework: nonlinear and multimodal exploration of image search result spaces
The extensive information delivery power and an immense volume of image objects make them frequently use multimedia content over the web. However,...
-
Multimodal Human Computer Interaction Using Hand Gestures and Speech
The paper presents multimodal human-computer interaction using speech and gesture recognition to develop a system for mouse movement and operation....
-
Multimodal motivation modelling and computing towards motivationally intelligent E-learning systems
Motivation to engage in learning is essential for learning performance. Learners’ motivation is traditionally assessed using self-reported data,...
