Search for dissertations about: "Multimodal interaction"

Showing result 1 - 5 of 73 swedish dissertations containing the words Multimodal interaction.

  2. 1. Adaptive Robot Presenters : Modelling Grounding in Multimodal Interaction

    Author : Agnes Axelsson; Gabriel Skantze; Johan Boye; Elisabeth André; KTH; []
    Keywords : NATURVETENSKAP; NATURAL SCIENCES; TEKNIK OCH TEKNOLOGIER; ENGINEERING AND TECHNOLOGY; NATURVETENSKAP; NATURAL SCIENCES; Human-robot interaction; Dialogue; Presentation; Museum; Grounding; Multimodal; Feedback; Classification; Knowledge graphs; KG; KG-to-text; WebNLG; System; Learning; Large Language Model; LLM; människa-robot-interaktion; hri; dialog; presentation; museum; grundning; multimodal; multimodalitet; återmatning; klassifikation; kunskapsgraf; kg; kg-till-text; data-tilltext; webnlg; system; inlärning; lärande. stor språkmodell; llm; Speech and Music Communication; Tal- och musikkommunikation;

    Abstract : This thesis addresses the topic of grounding in human-robot interaction, that is, the process by which the human and robot can ensure mutual understanding. To explore this topic, the scenario of a robot holding a presentation to a human audience is used, where the robot has to process multimodal feedback from the human in order to adapt the presentation to the human's level of understanding. READ MORE

  4. 2. Tools in and out of sight : an analysis informed by Cultural-Historical Activity Theory of audio-haptic activities involving people with visual impairments supported by technology

    Author : Delphine Szymczak; Certec - Rehabiliteringsteknik och Design; []
    Keywords : TEKNIK OCH TEKNOLOGIER; ENGINEERING AND TECHNOLOGY; TEKNIK OCH TEKNOLOGIER; ENGINEERING AND TECHNOLOGY; haptic; multimodal; disability; interaction; Cultural Historical Activity Theory; open-source software;

    Abstract : The main purpose of this thesis is to present a Cultural-Historical Activity Theory (CHAT) based analysis of the activities conducted by and with visually impaired users supported by audio-haptic technology.This thesis covers several studies conducted in two projects. READ MORE

  5. 3. Sound perception and design in multimodal environments

    Author : PerMagnus Lindborg; Anders K. Friberg; Daniel Västfjäll; KTH; []
    Keywords : TEKNIK OCH TEKNOLOGIER; ENGINEERING AND TECHNOLOGY; TEKNIK OCH TEKNOLOGIER; ENGINEERING AND TECHNOLOGY; HUMANIORA; HUMANITIES; NATURVETENSKAP; NATURAL SCIENCES; SAMHÄLLSVETENSKAP; SOCIAL SCIENCES; sound; perception; design; multimodal; environment; soundscape; music; listening; crossmodal; psychoacoustics; psychophysiology; personality trait; emotion; appraisal; aesthetics; colour; correlation; regression; classification; sonification; Tal- och musikkommunikation; Speech and Music Communication;

    Abstract : This dissertation is about sound in context. Since sensory processing is inherently multimodal, research in sound is necessarily multidisciplinary. The present work has been guided by principles of systematicity, ecological validity, complementarity of  methods, and integration of science and art. READ MORE

  6. 4. Bringing the avatar to life : Studies and developments in facial communication for virtual agents and robots

    Author : Samer Al Moubayed; Jonas Beskow; Stefan Kopp; KTH; []
    Keywords : NATURVETENSKAP; NATURAL SCIENCES; Avatar; Speech Communication; Facial animation; Nonverbal; Social; Robot; Human-like; Face-to-face; Prosody; Pitch; Prominence; Furhat; Gaze; Head-pose; Dialogue; Interaction; Multimodal; Multiparty; SRA - ICT; SRA - Informations- och kommunikationsteknik;

    Abstract : The work presented in this thesis comes in pursuit of the ultimate goal of building spoken and embodied human-like interfaces that are able to interact with humans under human terms. Such interfaces need to employ the subtle, rich and multidimensional signals of communicative and social value that complement the stream of words – signals humans typically use when interacting with each other. READ MORE

  7. 5. Developing Multimodal Spoken Dialogue Systems : Empirical Studies of Spoken Human–Computer Interaction

    Author : Joakim Gustafson; KTH; []
    Keywords : Spoken dialogue system; multimodal; speech; GUI; animated agents; embodied conversational characters; talking heads; empirical user studies; speech corpora; system evaluation; system development; Wizard of Oz simulations; system architecture; linguis; TECHNOLOGY; TEKNIKVETENSKAP;

    Abstract : This thesis presents work done during the last ten years on developing five multimodal spoken dialogue systems, and the empirical user studies that have been conducted with them. The dialogue systems have been multimodal, giving information both verbally with animated talking characters and graphically on maps and in text tables. READ MORE