A Multimodal Database for Mimicry Analysis

X. Sun, Jeroen Lichtenauer, Michel Valstar, Antinus Nijholt, Maja Pantic

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    30 Citations (Scopus)

    Abstract

    In this paper we introduce a multi-modal database for the analysis of human interaction, in particular mimicry, and elaborate on the theoretical hypotheses of the relationship between the occurrence of mimicry and human affect. The recorded experiments are designed to explore this relationship. The corpus is recorded with 18 synchronised audio and video sensors, and is annotated for many different phenomena, including dialogue acts, turn-taking, affect, head gestures, hand gestures, body movement and facial expression. Recordings were made of two experiments: a discussion on a political topic, and a role-playing game. 40 participants were recruited, all of whom selfreported their felt experiences. The corpus will be made available to the scientific community.
    Original languageUndefined
    Title of host publicationProceedings 4th International Conference on Affective Computing and Intelligent Interaction (ACII2011), Part I
    EditorsSidney D' Mello, Arthur Graesser, Björn Schuller, Jean-Claude Martin
    Place of PublicationBerlin
    PublisherSpringer
    Pages367-376
    Number of pages10
    ISBN (Print)978-3-642-24599-2
    DOIs
    Publication statusPublished - 10 Oct 2011
    Event4th International Conference on Affective Computing and Intelligent Interaction, ASCII 2011 - Memphis, United States
    Duration: 9 Oct 201112 Oct 2011
    Conference number: 4

    Publication series

    NameLecture Notes in Computer Science
    PublisherSpringer Verlag
    Volume6974
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference4th International Conference on Affective Computing and Intelligent Interaction, ASCII 2011
    Abbreviated titleASCII
    CountryUnited States
    CityMemphis
    Period9/10/1112/10/11

    Keywords

    • METIS-279160
    • IR-78299
    • annotation
    • Mimicry database
    • Affective Computing
    • EWI-20343
    • synchronized multi-sensor recording
    • Social Signal Processing
    • EC Grant Agreement nr.: FP7/231287
    • EC Grant Agreement nr.: ERC/203143
    • HMI-MI: MULTIMODAL INTERACTIONS
    • interaction scenario

    Cite this