Hoppa till huvudinnehållet
Till KTH:s startsida Till KTH:s startsida

DT2300 Sound in Interaction 7,5 hp

Course memo Spring 2022-60562

Version 1 – 12/23/2021, 2:10:10 PM

Course offering

ljudintv20 (Start date 18/01/2022, English)

Language Of Instruction

English

Offered By

EECS/Human Centered Technology

Course memo Spring 2022

Course presentation

A great part of human communication and interaction with the surrounding environment is based on sound. Sound pervades our life; speech, sounds produced by our interaction with the environment, and everyday sounds are the most common sounds that we hear continuously during the day. In spite of this, interaction in HCI is mainly vision-based. In a world where graphical displays are becoming smaller and sometimes missing, there is a need for a new way of human-machine interaction based on sound.

This course offers a multi-disciplinary overview of the principles underlying the use of sound in interaction between users and machines.

Videos of projects developed since the 2018 edition of the course can be found in the KTH Play channel DT2300 Sound in Interaction. Video of previous editions of the course can be found in Vimeo here (2016 & 2017), and here (2015 and before).

Headings denoted with an asterisk ( * ) is retrieved from the course syllabus version Spring 2022

Content and learning outcomes

Course contents

  • Basic principles of sound perception in interaction
  • The relationship between sound and movement
  • Sound as an information carrier
  • The use of sound as feedback in control applications, including haptics
  • Data representation with sound, including interactive sonification
  • Use of sound in treatment applications, including applications for people with disabilities
  • Sound and interaction in everyday life
  • Sound models for interaction, including models for portable devices

Intended learning outcomes

After passing the course, the student should be able to:

  • critically read a scientific paper on sound and interaction, and extract useful information from it
  • identify and describe the major principles for sound in interaction, including communication of information through sound, sound feedback in interaction, and sonification of movements
  • identify, describe and analyse properties of existing soundscapes and suggest changes for a better and sustainable sound environment 
  • identify, describe and analyse the control aspects of sound based interactive applications
  • evaluate how sound based interactive applications function
  • use free state-of-the-art software tools and sensors (based on Arduino, Raspberry Pi, or other platforms) for designing new sound-based interactive applications
  • propose efficient designs for new applications using sound in interaction that are both inclusive and sustainable
  • justify, document and present design, implementation and evaluation of a new application.

Learning activities

The course includes:

  • An overview of sound perception including the perception and recognition of sound sources, sound illusions, and experimental methodology (with particular focus on practical issues when experimenting with sound);

  • An overview of latest technology for the use of sound in interaction, including sound models, data sonification methods, sensor platforms;

  • Practical activities, which include a soundwalk (Links to an external site.) and three hands-on laboratory sessions where course participants can try and experiment with sound as material and with different methods and technology for sound design;

  • The realization of a project where each student will work in-depth within a selected area of interest, but following a theme. The theme for 2022 is "The soundscape of the future", that includes future sounds in everyday interactions, future sounds of cities, robots, homes, office environments, industries, devices.

Preparations before course start

Recommended prerequisites

Proficiency in human-computer interaction and programming skills corresponding to first term of master programs Interactive Media Technology (TIMTM) or Computer Science (TCSCM).

Knowledge about human perception, corresponding to course DM2350 (former DT2350), and about multimodal interaction, corresponding to course DT2140 is reccomended but not necessary.

Literature

For each lecture in the course there is a list of compulsory and suggested scientific papers that can be downloaded from the course page. The list of papers is updated every year.

We also recommended two books for extra reading:

Examination and completion

Grading scale

A, B, C, D, E, FX, F

Examination

  • INL1 - Assignments, 1.5 credits, Grading scale: A, B, C, D, E, FX, F
  • LAB1 - Laboratory Assignments, 3.0 credits, Grading scale: P, F
  • PRO1 - Project, 3.0 credits, Grading scale: A, B, C, D, E, FX, F

Based on recommendation from KTH’s coordinator for disabilities, the examiner will decide how to adapt an examination for students with documented disability.

The examiner may apply another examination format when re-examining individual students.

The section below is not retrieved from the course syllabus:

Assignments ( INL1 )

Laboratory Assignments ( LAB1 )

Project ( PRO1 )

Ethical approach

  • All members of a group are responsible for the group's work.
  • In any assessment, every student shall honestly disclose any help received and sources used.
  • In an oral assessment, every student shall be able to present and answer questions about the entire assignment and solution.

Further information

Changes of the course before this course offering

We will adopt the changes made for the 2021 version of the course.

As suggested by some students at the end of the 2020 edition of the course, we added two short modules about two software tools that can be used in laboratory sessions and projects. One module about SuperCollider and one about Pure Data. The modules are based on a short video lecture, a PDF file with text instructions and suggestions, and some useful code examples which could be used in the final project.

From the 2022 edition of the course these two modules are compulsory (P/F) since we noticed that studnet have a great benefit by taking them.

 

Round Facts

Start date

18 Jan 2022

Course offering

  • ljudintv20 Spring 2022-60562

Language Of Instruction

English

Offered By

EECS/Human Centered Technology

Contacts