Record, Transform & Reproduce Social Encounters in Immersive VR: An Iterative Approach

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    47 Downloads (Pure)


    Immersive Virtual Reality Environments that can be accessed through multimodal natural interfaces will bring new affordances to mediated interaction with virtual embodied agents and avatars. Such interfaces will measure, amongst others, users' poses and motion which can be copied to an embodied avatar representation of the user that is situated in a virtual or augmented reality space shared with autonomous virtual agents and human controlled or semi-autonomous avatars. Designers of such environments will be challenged to facilitate believable social interactions by creating agents or semi-autonomous avatars that can respond meaningfully to users' natural behaviors, as captured by these interfaces. In our future research, we aim to realize such interactions to create rich social encounters in immersive Virtual Reality. In this current work, we present the approach we envisage to analyze and learn agent behavior from human-agent interaction in an iterative fashion. We specifically look at small-scale, `regulative' nonverbal behaviors. Agents inform their behavior on previous observations, observing responses that these behaviors elicit in new users, thus iteratively generating corpora of short, situated human-agent interaction sequences that are to be analyzed, annotated and processed to generate socially intelligent agent behavior. Some choices and challenges of this approach are discussed.
    Original languageUndefined
    Title of host publicationProceedings of the 2015 ACM on International Conference on Multimodal Interaction (ICMI 2015)
    Place of PublicationNew York
    PublisherAssociation for Computing Machinery (ACM)
    Number of pages4
    ISBN (Print)978-1-4503-3912-4
    Publication statusPublished - 9 Nov 2015
    Event17th ACM International Conference on Multimodal Interaction, ICMI 2015 - Seattle, United States
    Duration: 9 Nov 201513 Nov 2015
    Conference number: 17

    Publication series



    Conference17th ACM International Conference on Multimodal Interaction, ICMI 2015
    Abbreviated titleICMI
    Country/TerritoryUnited States


    • EWI-26628
    • IR-98914
    • METIS-315123

    Cite this