Automatic Understanding of Affective and Social Signals by Multimodal Mimicry Recognition

X. Sun, Khiet Phuong Truong, Antinus Nijholt, Maja Pantic

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    4 Citations (Scopus)

    Abstract

    Human mimicry is one of the important behavioral cues displayed during social interaction that inform us about the interlocutors' interpersonal states and attitudes. For example, the absence of mimicry is usually associated with negative attitudes. A system capable of analyzing and understanding mimicry behavior could enhance social interaction, both in human-human and human-machine interaction, by informing the interlocutors about each other's interpersonal attitudes and feelings of affiliation. Hence, our research focus is the investigation of mimicry in social human-human and human-machine interactions with the aim to help improve the quality of these interactions. In particular, we aim to develop automatic multimodal mimicry analyzers, to enhance affect recognition and social signal understanding systems through mimicry analysis, and to implement mimicry behavior in Embodied Conversational Agents. This paper surveys and discusses the recent work we have carried out regarding these aims. It is meant to serve as an ultimate goal and a guide for determining recommendations for the development of automatic mimicry analyzers to facilitate affective computing and social signal processing.
    Original languageUndefined
    Title of host publicationProceedings 4th International Conference on Affective Computing and Intelligent Interaction (ACII 2011)
    EditorsS. D' Mello, A. Graesser, B. Schuller, J-C. Martin
    Place of PublicationBerlin
    PublisherSpringer
    Pages289-296
    Number of pages8
    ISBN (Print)978-3-642-24570-1
    DOIs
    Publication statusPublished - 10 Oct 2011
    Event4th International Conference on Affective Computing and Intelligent Interaction, ASCII 2011 - Memphis, United States
    Duration: 9 Oct 201112 Oct 2011
    Conference number: 4

    Publication series

    NameLecture Notes in Computer Science
    PublisherSpringer Verlag
    Volume6975
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference4th International Conference on Affective Computing and Intelligent Interaction, ASCII 2011
    Abbreviated titleASCII
    CountryUnited States
    CityMemphis
    Period9/10/1112/10/11

    Keywords

    • METIS-279158
    • IR-78291
    • Embodied Conversational Agent
    • EWI-20326
    • Social Signal Processing
    • mimicry recognition
    • HMI-MI: MULTIMODAL INTERACTIONS
    • Affective Computing

    Cite this