Preferred modalities in dialogue systems

Vildan Bilici, Emiel Krahmer, Saskia Te Riele, Raymond Veldhuis

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

14 Citations (Scopus)
29 Downloads (Pure)


This research describes which modalities are preferred in particular contexts when interacting with a multi-modal dialogue system. The trade-off between three factors is investigated: (i) speech recognition performance, (ii) efficiency of input modality and (iii) the system's output modality. Four versions were developed of a multimodal examinator to be used in elementary school. The versions differed in recognition performance ('perfect' vs. realistic) and output modality (speech or text). In all systems, subjects could provide input via speaking or typing. Answer length in characters was used as a measure of efficiency. Results show that both speech recognition performance and efficiency have a strong impact on preferred modalities. No effect was found of the system's output modality.

Original languageEnglish
Title of host publication6th International Conference on Spoken Language Processing, ICSLP 2000
Place of PublicationBeijing
PublisherChina Military Friendship Pub.
ISBN (Print)7801501144
Publication statusPublished - 1 Jan 2000
Externally publishedYes
Event6th International Conference on Spoken Language Processing, ICSLP 2000 - Beijing, China
Duration: 16 Oct 200020 Oct 2000
Conference number: 6


Conference6th International Conference on Spoken Language Processing, ICSLP 2000
Abbreviated titleICSLP


Dive into the research topics of 'Preferred modalities in dialogue systems'. Together they form a unique fingerprint.

Cite this