DT2140 Multimodal Interaction and Interfaces 7.5 credits

Multimodala interaktioner och gränssnitt

Humans are using multimodality extensively to communicate with each other, either simultaneously (in face-to-face conversations) or alternatively (using speech, writing, gestures, touch). The communication with computers has on the other hand traditionally employed few modalities: the user provides input with keyboard or mouse and the computer responds visually, in the form of text or icons.

This course gives an introduction to new interfaces that can improve the experience or the efficiency of the interaction with computers (such as voice control, sound interaction, gesture recognition, touch screens, haptic feedback, augmented reality).

Show course information based on the chosen semester and course offering:

Offering and execution

No offering selected

Select the semester and course offering above to get information from the correct course syllabus and course offering.

Course information

Content and learning outcomes

Course contents *

The course will give the students theoretical and practical introductions to multimodal communication and different types of HCI interfaces.

The main focus is on techniques for

- user input, such as speech recognition, touch screens or eye and gesture tracking, and

- computer output, such as unconventional display devices, speech synthesis, sounding objects and haptic devices.

In particular the effects of combining different modalities are addressed.

Intended learning outcomes *

After completing the course, you should be able to:

  • describe the functionality of state-of-the-art multimodal or alternative HCI interfaces
  • evaluate the strengths and weaknesses of multimodal interfaces
  • implement human-computer interaction interfaces employing new interaction techniques for restricted tasks
  • propose efficient designs for new interfaces employing different modalities

in order to be able to

  • deepen your knowledge about the interaction modalities of interest in advanced courses
  • employ multimodality in applied project work
  • choose suitable interfaces for a given task (from an HCI and technical perspective).

Course Disposition

No information inserted

Literature and preparations

Specific prerequisites *

Single course students: 90 university credits including 45 university credits in Mathematics or Information Technology. English B, or equivalent.   

Recommended prerequisites

Proficiency in human-computer interaction and good programming skills (corresponding e.g. to DD1341 Introduction to Computer Science).

Equipment

No information inserted

Literature

No information inserted

Examination and completion

Grading scale *

A, B, C, D, E, FX, F

Examination *

  • INLA - Assignments, 1.5 credits, Grading scale: A, B, C, D, E, FX, F
  • LABA - Laboratory Assignments, 1.5 credits, Grading scale: P, F
  • PROA - Project, 4.5 credits, Grading scale: A, B, C, D, E, FX, F

Based on recommendation from KTH’s coordinator for disabilities, the examiner will decide how to adapt an examination for students with documented disability.

The examiner may apply another examination format when re-examining individual students.

In this course all the regulations of the code of honor at the School of Computer science and Communication apply, see: http://www.kth.se/csc/student/hederskodex/1.17237?l=en_UK.

Opportunity to complete the requirements via supplementary examination

No information inserted

Opportunity to raise an approved grade via renewed examination

No information inserted

Examiner

Gabriel Skantze

Further information

Course web

Further information about the course can be found on the Course web at the link below. Information on the Course web will later be moved to this site.

Course web DT2140

Offered by

EECS/Human Centered Technology

Main field of study *

Computer Science and Engineering

Education cycle *

Second cycle

Add-on studies

  •  DH2323 Computer Graphics and Interaction
  •  DT2112 Speech Technology
  •  DT2300 Sound in Interaction
  •  DT2213 Musical Communication and Music Technology
  •  DH2660 Haptics

Contact

Gabriel Skantze, e-post: gabriel@speech.kth.se

Ethical approach *

  • All members of a group are responsible for the group's work.
  • In any assessment, every student shall honestly disclose any help received and sources used.
  • In an oral assessment, every student shall be able to present and answer questions about the entire assignment and solution.

Supplementary information

In this course, the EECS code of honor applies, see:
http://www.kth.se/en/eecs/utbildning/hederskodex