Skip to main content

Revealing the secrets of the human voice

News

Published May 13, 2013

A model of the human voice, which is being built at KTH Royal Institute of Technology in Stockholm, could lead to better voice care, voice prosthetics, talking robots and teaching opportunities.

A moment is captured in this animation of vocal chords. Photo: J. Jansson, A. Holmberg, R. V. d. Abreu, C. Degirmenci , J. Hoffman, M. Karlsson och M. Åbom.

Three research groups from KTH are collaborating with voice and computing experts at universities and research institutes in France, Germany and Spain on the EUR 3 million Eunison project, which involves physical models, and simulated visualizations of the voice.

KTH music acoustics professor Sten Ternström says that project will render the 3-D physics of the voice, including its acoustic output, which would find profound applications in fields such as speech technology, medical research, pedagogy, linguistics and the arts.

“We need a better understanding of how the voice works and how it fails,” Ternström says.

KTH Music Acoustics Professor Sten Ternström. (Photo: Anna Ternström)

The university’s “Lindgren” supercomputer will provide the colossal computing resources for the project. “We are talking about fast movements of tens of thousands of points in three dimensions, so there will be many calculations requiring heavy computation,” Ternström says.

Though Eunison will rely on supercomputers to create simulations and visualisation, the project will also use mechanical models of the vocal chords, upper respiratory tract and tongue, made from silicone and plastic, to verify that the simulations are correctly calculated.

“The voice is a very complex phenomenon that requires a lot of work to emulate and understand,” Ternström says. “So, we are also interested in how much the model can be simplified, without affecting the voice sounds.”

Unlike previous research on the voice, Eunison will be an end-to-end look at the voice, combining findings from multiple disciplines. Previous efforts have been fragmentary, and the models that do exist – of parts such as the vocal chords or vocal tract – are simplified in order to avoid the heavy physics calculations, he says.

“Our complete model of the human voice will resemble a puppet,” Ternström says. “The scientist pulls on one or more strings, and then we can see what happens.”

Biomechanical models are used to study how voice sounds are created and propagated in the body. (Photo: M.Arnela and O.Guasch, La Salle R&D, Universitat Ramon Llull.

The voice model will be made operable online, so that researchers anywhere can enter data and get a visualisation.

Working with Ternström on the project at KTH are researchers Olov Engwall, Johan Hoffman, Johan Jansson and Örjan Ekeberg.

View the  Eunison homepage.

For more information, contact Sten Ternström at 08 - 790 78 55 or sten@speech.kth.se.

Peter Larsson