The project will develop machine learning methods for speech understanding that more closely resemble the biological approach to learning. [more]
FonaDyn - Phonatory Dynamics and States Funding: VR
The voice has several non-linear and context-dependent mechanisms that can give rise to distinct phonatory states. We submit that much of the observed variability in objective voice metrics results from the influence of such states, and will attempt to account for some of them, using a state-based analysis paradigm.
[more]
GetHomeSafe - Extended Multimodal Search and Communication Systems for Safe In-Car Application Funding: EU
The aim of the proposed project is to develop a system for safe information access and communication while driving. [more]
IURO - Interactive Urban Robot Funding: EU
The goal of IURO project is to develop a robot that can engage in information-gathering face-to-face interactions in multi-user settings. [more]
Lipread - Lipreading to support Foreign and Second Language Learning by Hearing Impaired and Normally Hearing Persons Funding: EU
The objective of the project is to develop a syllabus and an e-learning environment to teach lipreading of foreign and second languages. Our target groups: deaf and hard of hearing adults, their therapists and teachers, and normally hearing language learners.
[more]
Ljudparken/The Soundpark - Using modern smartphones to create interactive listening experiences for hearing impaired Funding: PTS - Post och Telestyrelsen
The aim of the project is to create interactive listening experiences for persons with hearing impairments through smartphone applications. Interactive listening applications will provide better conditions for partaking in commonly available audio-based entertainment, but also offer new possibilities for active heartraining. [more]
Ljudskrapan - The Soundscraper Funding: Promobilia Foundation
Ljudskrapan/The Soundscraper was initiated to help deaf children with additional sensory and cognitive function disorders to improve their possibilities for communication in order to facilitate emotional and cognitive development. The idea is to allow playful interaction with sound even with limited physical movements, and let sound provide an immediate sensory... [more]
MASSIVE - Large-scale massively multimodal modelling of non-verbal behaviour in spontaneous dialogue Funding: VR
The aim is to provide a large-scale kinematic database based on motion capture of human conversational behaviour, as well as to build statistical models of multimodal non-verbal behaviour in dialogue. [more]
SAMINK - Incremental processing in multimodal conversational systems Funding: VR
The aim of this project is to understand how conversational systems can engage in spoken face-to-face interaction in real-time. [more]
SAMPAUS - Classifying and deploying pauses for flow control in conversational systems Funding: VR
The project investigates how dialog system can employ pauses and fillers to help users better understand system utterance structure. [more]
SAMSYNT - Introducing interactional phenomena in speech synthesis Funding: VR
The project will develop and verify ways of including interactional phenomena in speech synthesis, resulting in well-described and tested methods for synthesizing these phenomena in such a way that they can be employed to recreate human interactional behaviour. [more]
SAVIR - Situated Audio Visual Interaction with Robots Funding: SRA/KTH
The projects investigate how a robot can improve its visual scene understanding by engaging in spoken dialogue with a human.
[more]
SEMIR - Bridging the semantic gap in Music Information Retrieval: Modelling perceptual-based features in music audio Funding: VR
This project aims at deveoping new computer tools for characterizing, and indexing music audio. [more]
SOM - The sound of motion: Providing sound feedback to human movements Funding: VR
The main aim of this project is the development of theories, models and tools for representing human movements by means of sound. This work is part of growing research fields known as data sonification, embodied music cognition and mediation technology. [more]
SONEA - Sonification of elite athletes Funding: Olympic Performance Centre
The main idea in the SONEA project is that of applying knowledge in the perception of everyday sounds, in sound synthesis techniques, and in interactive sonification, to the auditory representation of the movements of top-level athletes. [more]
Kulning - Hard rock - Twang - Belting - Chest/Falsetto - Whisper - High pitch singing - Text intelligibility - MRI
[more]
TIVOLI - Sign learning via game-based interaction Funding: PTS - Post och Telestyrelsen
TIVOLI aims to create learning application for sign language signs, in the form of a computer game featuring sign recogntion via webcam and a signing avatar. The target group is children with communication disorders. [more]
