Continuous Interaction with a Virtual Human

Dennis Reidsma, Khiet Phuong Truong, H. van Welbergen, Daniel Neiberg, Sathish Pammi, I.A. de Kok, B. van Straalen

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademic

    67 Downloads (Pure)

    Abstract

    Attentive Speaking and Active Listening require that a Virtual Human be capable of simultaneous perception/interpretation and production of communicative behavior. A Virtual Human should be able to signal its attitude and attention while it is listening to its interaction partner, and be able to attend to its interaction partner while it is speaking – and modify its communicative behavior on-the-fly based on what it perceives from its partner. This report presents the results of a four week summer project that was part of eNTERFACE’10. The project resulted in progress on several aspects of continuous interaction such as scheduling and interrupting multimodal behavior, automatic classification of listener responses, generation of response eliciting behavior, and models for appropriate reactions to listener responses. A pilot user study was conducted with ten participants. In addition, the project yielded a number of deliverables that are released for public access.
    Original languageUndefined
    Title of host publicationProceedings of the 6th International Summer Workshop on Multimodal Interfaces (eNTERFACE'10)
    EditorsAlbert Ali Salah, Theo Gevers
    Place of PublicationAmsterdam
    PublisherUniversity of Amsterdam
    Pages24-39
    Number of pages16
    ISBN (Print)978-90-5776-213-0
    Publication statusPublished - Aug 2010

    Publication series

    Name
    PublisherUniversity of Amsterdam

    Keywords

    • METIS-270693
    • Attentive Speaking
    • Continuous Interaction
    • EWI-16111
    • Virtual Humans
    • Listener Responses
    • IR-74044

    Cite this

    Reidsma, D., Truong, K. P., van Welbergen, H., Neiberg, D., Pammi, S., de Kok, I. A., & van Straalen, B. (2010). Continuous Interaction with a Virtual Human. In A. A. Salah, & T. Gevers (Eds.), Proceedings of the 6th International Summer Workshop on Multimodal Interfaces (eNTERFACE'10) (pp. 24-39). Amsterdam: University of Amsterdam.
    Reidsma, Dennis ; Truong, Khiet Phuong ; van Welbergen, H. ; Neiberg, Daniel ; Pammi, Sathish ; de Kok, I.A. ; van Straalen, B. / Continuous Interaction with a Virtual Human. Proceedings of the 6th International Summer Workshop on Multimodal Interfaces (eNTERFACE'10). editor / Albert Ali Salah ; Theo Gevers. Amsterdam : University of Amsterdam, 2010. pp. 24-39
    @inproceedings{0c16067240374cc5a8066a3e9c882544,
    title = "Continuous Interaction with a Virtual Human",
    abstract = "Attentive Speaking and Active Listening require that a Virtual Human be capable of simultaneous perception/interpretation and production of communicative behavior. A Virtual Human should be able to signal its attitude and attention while it is listening to its interaction partner, and be able to attend to its interaction partner while it is speaking – and modify its communicative behavior on-the-fly based on what it perceives from its partner. This report presents the results of a four week summer project that was part of eNTERFACE’10. The project resulted in progress on several aspects of continuous interaction such as scheduling and interrupting multimodal behavior, automatic classification of listener responses, generation of response eliciting behavior, and models for appropriate reactions to listener responses. A pilot user study was conducted with ten participants. In addition, the project yielded a number of deliverables that are released for public access.",
    keywords = "METIS-270693, Attentive Speaking, Continuous Interaction, EWI-16111, Virtual Humans, Listener Responses, IR-74044",
    author = "Dennis Reidsma and Truong, {Khiet Phuong} and {van Welbergen}, H. and Daniel Neiberg and Sathish Pammi and {de Kok}, I.A. and {van Straalen}, B.",
    year = "2010",
    month = "8",
    language = "Undefined",
    isbn = "978-90-5776-213-0",
    publisher = "University of Amsterdam",
    pages = "24--39",
    editor = "Salah, {Albert Ali} and Theo Gevers",
    booktitle = "Proceedings of the 6th International Summer Workshop on Multimodal Interfaces (eNTERFACE'10)",

    }

    Reidsma, D, Truong, KP, van Welbergen, H, Neiberg, D, Pammi, S, de Kok, IA & van Straalen, B 2010, Continuous Interaction with a Virtual Human. in AA Salah & T Gevers (eds), Proceedings of the 6th International Summer Workshop on Multimodal Interfaces (eNTERFACE'10). University of Amsterdam, Amsterdam, pp. 24-39.

    Continuous Interaction with a Virtual Human. / Reidsma, Dennis; Truong, Khiet Phuong; van Welbergen, H.; Neiberg, Daniel; Pammi, Sathish; de Kok, I.A.; van Straalen, B.

    Proceedings of the 6th International Summer Workshop on Multimodal Interfaces (eNTERFACE'10). ed. / Albert Ali Salah; Theo Gevers. Amsterdam : University of Amsterdam, 2010. p. 24-39.

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademic

    TY - GEN

    T1 - Continuous Interaction with a Virtual Human

    AU - Reidsma, Dennis

    AU - Truong, Khiet Phuong

    AU - van Welbergen, H.

    AU - Neiberg, Daniel

    AU - Pammi, Sathish

    AU - de Kok, I.A.

    AU - van Straalen, B.

    PY - 2010/8

    Y1 - 2010/8

    N2 - Attentive Speaking and Active Listening require that a Virtual Human be capable of simultaneous perception/interpretation and production of communicative behavior. A Virtual Human should be able to signal its attitude and attention while it is listening to its interaction partner, and be able to attend to its interaction partner while it is speaking – and modify its communicative behavior on-the-fly based on what it perceives from its partner. This report presents the results of a four week summer project that was part of eNTERFACE’10. The project resulted in progress on several aspects of continuous interaction such as scheduling and interrupting multimodal behavior, automatic classification of listener responses, generation of response eliciting behavior, and models for appropriate reactions to listener responses. A pilot user study was conducted with ten participants. In addition, the project yielded a number of deliverables that are released for public access.

    AB - Attentive Speaking and Active Listening require that a Virtual Human be capable of simultaneous perception/interpretation and production of communicative behavior. A Virtual Human should be able to signal its attitude and attention while it is listening to its interaction partner, and be able to attend to its interaction partner while it is speaking – and modify its communicative behavior on-the-fly based on what it perceives from its partner. This report presents the results of a four week summer project that was part of eNTERFACE’10. The project resulted in progress on several aspects of continuous interaction such as scheduling and interrupting multimodal behavior, automatic classification of listener responses, generation of response eliciting behavior, and models for appropriate reactions to listener responses. A pilot user study was conducted with ten participants. In addition, the project yielded a number of deliverables that are released for public access.

    KW - METIS-270693

    KW - Attentive Speaking

    KW - Continuous Interaction

    KW - EWI-16111

    KW - Virtual Humans

    KW - Listener Responses

    KW - IR-74044

    M3 - Conference contribution

    SN - 978-90-5776-213-0

    SP - 24

    EP - 39

    BT - Proceedings of the 6th International Summer Workshop on Multimodal Interfaces (eNTERFACE'10)

    A2 - Salah, Albert Ali

    A2 - Gevers, Theo

    PB - University of Amsterdam

    CY - Amsterdam

    ER -

    Reidsma D, Truong KP, van Welbergen H, Neiberg D, Pammi S, de Kok IA et al. Continuous Interaction with a Virtual Human. In Salah AA, Gevers T, editors, Proceedings of the 6th International Summer Workshop on Multimodal Interfaces (eNTERFACE'10). Amsterdam: University of Amsterdam. 2010. p. 24-39