DT2140 Multimodal Interaction and Interfaces 7.5 credits

Multimodala interaktioner och gränssnitt

Please note

The information on this page is based on a course syllabus that is not yet valid.

Humans are using multimodality extensively to communicate with each other, either simultaneously (in face-to-face conversations) or alternatively (using speech, writing, gestures, touch). The communication with computers has on the other hand traditionally employed few modalities: the user provides input with keyboard or mouse and the computer responds visually, in the form of text or icons.

This course gives an introduction to new interfaces that can improve the experience or the efficiency of the interaction with computers (such as voice control, sound interaction, gesture recognition, touch screens, haptic feedback, augmented reality).

  • Education cycle

    Second cycle
  • Main field of study

    Computer Science and Engineering
  • Grading scale

    A, B, C, D, E, FX, F

Course offerings

Autumn 18 mintint18 for programme students

Autumn 18 SAP for Study Abroad Programme (SAP)

  • Periods

    Autumn 18 P2 (7.5 credits)

  • Application code

    10071

  • Start date

    29/10/2018

  • End date

    14/01/2019

  • Language of instruction

    English

  • Campus

    KTH Campus

  • Tutoring time

    Daytime

  • Form of study

    Normal

  • Number of places *

    Max. 5

    *) If there are more applicants than number of places selection will be made.

  • Course responsible

    Gabriel Skantze <skantze@kth.se>

  • Teacher

    Eva-Lotta Sallnäs Pysander <evalotta@kth.se>

    Kalin Stefanov <kalins@kth.se>

    Mario Romero Vega <marior@kth.se>

    Roberto Bresin <roberto@kth.se>

  • Target group

    Only open for students within the SAP-programme.

Autumn 19 mintint18 for programme students

Intended learning outcomes

After completing the course, you should be able to:

  • describe the functionality of state-of-the-art multimodal or alternative HCI interfaces
  • evaluate the strengths and weaknesses of multimodal interfaces
  • implement human-computer interaction interfaces employing new interaction techniques for restricted tasks
  • propose efficient designs for new interfaces employing different modalities

in order to be able to

  • deepen your knowledge about the interaction modalities of interest in advanced courses
  • employ multimodality in applied project work
  • choose suitable interfaces for a given task (from an HCI and technical perspective).

Course main content

The course will give the students theoretical and practical introductions to multimodal communication and different types of HCI interfaces.

The main focus is on techniques for

- user input, such as speech recognition, touch screens or eye and gesture tracking, and

- computer output, such as unconventional display devices, speech synthesis, sounding objects and haptic devices.

In particular the effects of combining different modalities are addressed.

Eligibility

Single course students: 90 university credits including 45 university credits in Mathematics or Information Technology. English B, or equivalent.   

Recommended prerequisites

Proficiency in human-computer interaction and good programming skills (corresponding e.g. to DD1341 Introduction to Computer Science).

Literature

Examination

  • INLA - Assignments, 1.5, grading scale: A, B, C, D, E, FX, F
  • LABA - Laboratory Assignments, 1.5, grading scale: P, F
  • PROA - Project, 4.5, grading scale: A, B, C, D, E, FX, F

In this course all the regulations of the code of honor at the School of Computer science and Communication apply, see: http://www.kth.se/csc/student/hederskodex/1.17237?l=en_UK.

Offered by

EECS/Media Technology and Interaction Design

Contact

Gabriel Skantze, e-post: gabriel@speech.kth.se

Examiner

Gabriel Skantze <skantze@kth.se>

Add-on studies

  •  DH2323 Computer Graphics and Interaction
  •  DT2112 Speech Technology
  •  DT2300 Sound in Interaction
  •  DT2213 Musical Communication and Music Technology
  •  DH2660 Haptics

Version

Course syllabus valid from: Spring 2019.
Examination information valid from: Spring 2019.