Spv: Roberto Bresin
Project 1: Sonification of information in social media
Objective: Develop a method for the sonification of information in social media applications (such as #tags, @names, smileys, emojis, keywords, etc.)
Background: Overload of information arriving in the form of text messages/reminders.
Challenges: Use sound instead of visuals for alerts/communication in social media apps
Technologies: Programming, social media APIs
Outcome: A new method and/or application for the sonification of information in social media applications
Relevance/Impact: this is new and can have an impact in different fields, including special needs
Supervisor: Roberto Bresin
Project 2: A cheap device for sonic and visual navigation in a 3D virtual environment
Objective: Development of an “open hardware”-based new device based on a Raspberry Pi for sonic and visual display of virtual objects and navigation in a 3D multimodal virtual environment.
Background: Navigation in VE.
Challenges: To design a device build with off-the-shelf technology and easy of use
Technologies: Raspberry Pi, Audio synthesis, Visual DIsplay, Gesture recognition/analysis, Programming, Mocap
Outcome: A new cheap amd open device/method for visual and sonic displaying of objects (and navigation) in 3D virtual environments. Many devices can be used at the same time in the same VE.
Relevance/Impact: this is “new” and can have an impact in different fields, including special needs
Supervisors: Roberto Bresin, Adrian Latupeirissa, Claudio Panariello
Project 3: Sonic dress for humanoid robots
Objective: Develop an interactive sonic dress for humanoid robots (such as the Pepper robot). The dress is provided with a number of small loudspeakers, placed in correspondence of different body parts, which should provide a meaningful sonic feedback in correspondence to robot movements, thus enhancing the perception of robot movements.
Background: Nebula
Challenges: A sonic dress for robot sound feedback has not been investigated so far
Technologies: Audio analysis, Audio synthesis, Programming, Small loudspeakers attached to a dress, Pepper robot
Outcome: A new method for displaying sonic feedback from a humanoid robot
Relevance/Impact: this is “new” and can have an impact in different fields, including special needs
Supervisors: Roberto Bresin, Adrian Latupeirissa, Claudio Panariello
Project 4: The sound of smell
Objective: Investigate the possibility of communicating the sense of smell through sound.
Background: Foleys in movies are also used for eliciting the sense of smell (e.g. “the sound of a leather jacket must communicate the smell of leather”). Also, Human Olfaction research and Olfactory dining: designing for the dominant sense
Challenges: The use of sound for eliciting smell has not been investigated so far.
Technologies: Interviews with Foley artists, Audio analysis, Sound design, Programming
Outcome: Sound design suggestions for communicating the sense of specific smells.
Relevance/Impact: this is “new” and can have an impact in different fields, including special needs
Supervisor: Roberto Bresin
Project 5: Color display of emotions in music
Objective: Develop a method for the automatic color display of emotions in music
Background: Previous research results by RB, by DM2350 students, and by a few other researchers
Challenges: Make it both general and personalized
Technologies: Audio analysis, Programming
Outcome: A new method and/or application for color representation of emotions in music
Relevance/Impact: this is “new” and can have impact in different fields, including special needs
Supervisor: Roberto Bresin
Project 6: Design of the soundscape of everyday activities and social media data
Background: Sonification is defined as the use of non-speech audio to convey information. More specifically, sonification is the transformation of data relations into perceived relations in an acoustic signal for the purposes of facilitating communication or interpretation.” (Kramer et al., in NSF Sonification report, 1999) – Humans are very skilled in discriminating differences between sounds, and in recognize information embedded in sounds – The underlying question is if it is possible to use these human skills for communicating information embedded in a text message only with non-speech sounds
Part 1: Record and list all sounds arriving to our ears during the day in the period of 1 week. From the recorded sounds, extract information such as: Characteristics, Functions, Locations, Time of the day
Part 2: Propose design guidelines and implement some example applications for the sonification of everyday activities, including social media data, using results from Part 2.
Supervisor: Roberto Bresin
Project 7: The soundscape of the future
Objective: Design a proposal for possible soundscapes of the future, for example in working places, city traffic, city places (i.e. squares, shopping streets).
Background: soundscapes, sonification, sound design in movies
Challenges: Identify possible sonic scenarios of the future.
Technologies: Foley artists, Design fiction, Audio analysis, Audio synthesis, Programming,
Outcome: Sound design suggestions for the synthesis of some soundscapes of the future.
Relevance/Impact: this is “new” and can have an impact in different fields, including special needs
Supervisors: Roberto Bresin, Sandra Pauletto, Kjetil Falkenberg