Error detection in spoken human-machine interaction

E. Krahmer, M. Swerts, Mariet Theune, M. Weegels

    Research output: Contribution to journalArticleAcademicpeer-review

    27 Citations (Scopus)
    2 Downloads (Pure)


    Given the state of the art of current language and speech technology, errors are unavoidable in present-day spoken dialogue systems. Therefore, one of the main concerns in dialogue design is how to decide whether or not the system has understood the user correctly. In human-human communication, dialogue participants are continuously sending and receiving signals on the status of the information being exchanged. We claim that if spoken dialogue systems were able to detect such cues and change their strategy accordingly, the interaction between user and system would improve. The goals of the present study are therefore twofold: (i) to find out which positive and negative cues people actually use in human-machine interaction in response to explicit and implicit verification questions and how informative these signals are, and (ii) to explore the possibilities of spotting errors automatically and on-line. To reach these goals, we first perform a descriptive analysis, followed by experiments with memory-based machine learning techniques. It appears that people systematically use negative/marked cues when there are communication problems. The experiments using memory-based machine learning techniques suggest that it may be possible to spot errors automatically and on-line with high accuracy, in particular when focussing on combinations of cues. This kind of information may turn out to be highly relevant for spoken dialogue systems, e.g., by providing quantitative criteria for changing the dialogue strategy or speech recognition engine. Keywords: spoken dialogue systems - error detection - error handling
    Original languageUndefined
    Article number10.1023/A:1009648614566
    Pages (from-to)19-29
    Number of pages11
    JournalInternational journal of speech technology
    Issue number1
    Publication statusPublished - Mar 2001


    • IR-63337
    • EWI-6587

    Cite this