Continuous Interaction with a Virtual Human

Dennis Reidsma, A.A. Salah (Editor), T. Gevers (Editor), I.A. de Kok, Daniel Neiberg, Sathish Chandra Pammi, B. van Straalen, Khiet Phuong Truong, H. van Welbergen

    Research output: Contribution to journalArticleAcademicpeer-review

    17 Citations (Scopus)
    56 Downloads (Pure)

    Abstract

    This paper presents our progress in developing a Virtual Human capable of being an attentive speaker. Such a Virtual Human should be able to attend to its interaction partner while it is speaking—and modify its communicative behavior on-the-fly based on what it observes in the behavior of its partner. We report new developments concerning a number of aspects, such as scheduling and interrupting multimodal behavior, automatic classification of listener responses, generation of response eliciting behavior, and strategies for generating appropriate reactions to listener responses. On the basis of this progress, a task-based setup for a responsive Virtual Human was implemented to carry out two user studies, the results of which are presented and discussed in this paper.
    Original languageUndefined
    Pages (from-to)97-118
    Number of pages22
    JournalJournal on multimodal user interfaces
    Volume4
    Issue number2
    DOIs
    Publication statusPublished - 2011

    Keywords

    • EWI-20355
    • METIS-277727
    • IR-77798
    • Virtual Humans
    • Attentive Speaking
    • Listener Responses
    • Continuous Interaction

    Cite this

    Reidsma, D., Salah, A. A. (Ed.), Gevers, T. (Ed.), de Kok, I. A., Neiberg, D., Pammi, S. C., ... van Welbergen, H. (2011). Continuous Interaction with a Virtual Human. Journal on multimodal user interfaces, 4(2), 97-118. https://doi.org/10.1007/s12193-011-0060-x
    Reidsma, Dennis ; Salah, A.A. (Editor) ; Gevers, T. (Editor) ; de Kok, I.A. ; Neiberg, Daniel ; Pammi, Sathish Chandra ; van Straalen, B. ; Truong, Khiet Phuong ; van Welbergen, H. / Continuous Interaction with a Virtual Human. In: Journal on multimodal user interfaces. 2011 ; Vol. 4, No. 2. pp. 97-118.
    @article{002ba1ff046b4d2d86f821a54b01bdb8,
    title = "Continuous Interaction with a Virtual Human",
    abstract = "This paper presents our progress in developing a Virtual Human capable of being an attentive speaker. Such a Virtual Human should be able to attend to its interaction partner while it is speaking—and modify its communicative behavior on-the-fly based on what it observes in the behavior of its partner. We report new developments concerning a number of aspects, such as scheduling and interrupting multimodal behavior, automatic classification of listener responses, generation of response eliciting behavior, and strategies for generating appropriate reactions to listener responses. On the basis of this progress, a task-based setup for a responsive Virtual Human was implemented to carry out two user studies, the results of which are presented and discussed in this paper.",
    keywords = "EWI-20355, METIS-277727, IR-77798, Virtual Humans, Attentive Speaking, Listener Responses, Continuous Interaction",
    author = "Dennis Reidsma and A.A. Salah and T. Gevers and {de Kok}, I.A. and Daniel Neiberg and Pammi, {Sathish Chandra} and {van Straalen}, B. and Truong, {Khiet Phuong} and {van Welbergen}, H.",
    note = "eemcs-eprint-20355",
    year = "2011",
    doi = "10.1007/s12193-011-0060-x",
    language = "Undefined",
    volume = "4",
    pages = "97--118",
    journal = "Journal on multimodal user interfaces",
    issn = "1783-7677",
    publisher = "Springer",
    number = "2",

    }

    Reidsma, D, Salah, AA (ed.), Gevers, T (ed.), de Kok, IA, Neiberg, D, Pammi, SC, van Straalen, B, Truong, KP & van Welbergen, H 2011, 'Continuous Interaction with a Virtual Human', Journal on multimodal user interfaces, vol. 4, no. 2, pp. 97-118. https://doi.org/10.1007/s12193-011-0060-x

    Continuous Interaction with a Virtual Human. / Reidsma, Dennis; Salah, A.A. (Editor); Gevers, T. (Editor); de Kok, I.A.; Neiberg, Daniel; Pammi, Sathish Chandra; van Straalen, B.; Truong, Khiet Phuong; van Welbergen, H.

    In: Journal on multimodal user interfaces, Vol. 4, No. 2, 2011, p. 97-118.

    Research output: Contribution to journalArticleAcademicpeer-review

    TY - JOUR

    T1 - Continuous Interaction with a Virtual Human

    AU - Reidsma, Dennis

    AU - de Kok, I.A.

    AU - Neiberg, Daniel

    AU - Pammi, Sathish Chandra

    AU - van Straalen, B.

    AU - Truong, Khiet Phuong

    AU - van Welbergen, H.

    A2 - Salah, A.A.

    A2 - Gevers, T.

    N1 - eemcs-eprint-20355

    PY - 2011

    Y1 - 2011

    N2 - This paper presents our progress in developing a Virtual Human capable of being an attentive speaker. Such a Virtual Human should be able to attend to its interaction partner while it is speaking—and modify its communicative behavior on-the-fly based on what it observes in the behavior of its partner. We report new developments concerning a number of aspects, such as scheduling and interrupting multimodal behavior, automatic classification of listener responses, generation of response eliciting behavior, and strategies for generating appropriate reactions to listener responses. On the basis of this progress, a task-based setup for a responsive Virtual Human was implemented to carry out two user studies, the results of which are presented and discussed in this paper.

    AB - This paper presents our progress in developing a Virtual Human capable of being an attentive speaker. Such a Virtual Human should be able to attend to its interaction partner while it is speaking—and modify its communicative behavior on-the-fly based on what it observes in the behavior of its partner. We report new developments concerning a number of aspects, such as scheduling and interrupting multimodal behavior, automatic classification of listener responses, generation of response eliciting behavior, and strategies for generating appropriate reactions to listener responses. On the basis of this progress, a task-based setup for a responsive Virtual Human was implemented to carry out two user studies, the results of which are presented and discussed in this paper.

    KW - EWI-20355

    KW - METIS-277727

    KW - IR-77798

    KW - Virtual Humans

    KW - Attentive Speaking

    KW - Listener Responses

    KW - Continuous Interaction

    U2 - 10.1007/s12193-011-0060-x

    DO - 10.1007/s12193-011-0060-x

    M3 - Article

    VL - 4

    SP - 97

    EP - 118

    JO - Journal on multimodal user interfaces

    JF - Journal on multimodal user interfaces

    SN - 1783-7677

    IS - 2

    ER -

    Reidsma D, Salah AA, (ed.), Gevers T, (ed.), de Kok IA, Neiberg D, Pammi SC et al. Continuous Interaction with a Virtual Human. Journal on multimodal user interfaces. 2011;4(2):97-118. https://doi.org/10.1007/s12193-011-0060-x