Automatic Understanding of Affective and Social Signals by Multimodal Mimicry Recognition

X. Sun, Khiet Phuong Truong, Antinus Nijholt, Maja Pantic

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    4 Citations (Scopus)
    5 Downloads (Pure)


    Human mimicry is one of the important behavioral cues displayed during social interaction that inform us about the interlocutors' interpersonal states and attitudes. For example, the absence of mimicry is usually associated with negative attitudes. A system capable of analyzing and understanding mimicry behavior could enhance social interaction, both in human-human and human-machine interaction, by informing the interlocutors about each other's interpersonal attitudes and feelings of affiliation. Hence, our research focus is the investigation of mimicry in social human-human and human-machine interactions with the aim to help improve the quality of these interactions. In particular, we aim to develop automatic multimodal mimicry analyzers, to enhance affect recognition and social signal understanding systems through mimicry analysis, and to implement mimicry behavior in Embodied Conversational Agents. This paper surveys and discusses the recent work we have carried out regarding these aims. It is meant to serve as an ultimate goal and a guide for determining recommendations for the development of automatic mimicry analyzers to facilitate affective computing and social signal processing.
    Original languageUndefined
    Title of host publicationProceedings 4th International Conference on Affective Computing and Intelligent Interaction (ACII 2011)
    EditorsS. D' Mello, A. Graesser, B. Schuller, J-C. Martin
    Place of PublicationBerlin
    Number of pages8
    ISBN (Print)978-3-642-24570-1
    Publication statusPublished - 10 Oct 2011
    Event4th International Conference on Affective Computing and Intelligent Interaction, ASCII 2011 - Memphis, United States
    Duration: 9 Oct 201112 Oct 2011
    Conference number: 4

    Publication series

    NameLecture Notes in Computer Science
    PublisherSpringer Verlag
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349


    Conference4th International Conference on Affective Computing and Intelligent Interaction, ASCII 2011
    Abbreviated titleASCII
    Country/TerritoryUnited States


    • METIS-279158
    • IR-78291
    • Embodied Conversational Agent
    • EWI-20326
    • Social Signal Processing
    • mimicry recognition
    • Affective Computing

    Cite this