Mutually coordinated anticipatory multimodal interaction

Antinus Nijholt, Dennis Reidsma, H. van Welbergen, Hendrikus J.A. op den Akker, Z.M. Ruttkay

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    17 Citations (Scopus)

    Abstract

    We introduce our research on anticipatory and coordinated interaction between a virtual human and a human partner. Rather than adhering to the turn taking paradigm, we choose to investigate interaction where there is simultaneous expressive behavior by the human interlocutor and a humanoid. We have designed various applications in which we can study and specify such behavior, in particular behavior that requires synchronization based on predictions from performance and perception. We have some preliminary observations – based on the literature and in analogy with our applications – on the role of predictions in conversations. Architectural consequences for the design of virtual humans are presented.
    Original languageUndefined
    Title of host publicationVerbal and Nonverbal Features of Human-Human and Human-Machine Interaction
    EditorsA. Esposito, N.G. Bourbakis, N. Avouris, I. Hatzilygeroudis
    Place of PublicationBerlin
    PublisherSpringer
    Pages70-89
    Number of pages20
    ISBN (Print)978-3-540-70871-1
    DOIs
    Publication statusPublished - 17 Dec 2008

    Publication series

    NameLecture Notes in Computer Science
    PublisherSpringer Verlag
    NumberDTR08-9/5042
    Volume5042
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Keywords

    • EWI-11601
    • HMI-MI: MULTIMODAL INTERACTIONS
    • METIS-251104
    • EC Grant Agreement nr.: FP6/033812
    • IR-62066

    Cite this

    Nijholt, A., Reidsma, D., van Welbergen, H., op den Akker, H. J. A., & Ruttkay, Z. M. (2008). Mutually coordinated anticipatory multimodal interaction. In A. Esposito, N. G. Bourbakis, N. Avouris, & I. Hatzilygeroudis (Eds.), Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction (pp. 70-89). [10.1007/978-3-540-70872-8_6] (Lecture Notes in Computer Science; Vol. 5042, No. DTR08-9/5042). Berlin: Springer. https://doi.org/10.1007/978-3-540-70872-8_6