The SEMAINE corpus of emotionally coloured character interactions

Gary McKeown, Michel F. Valstar, Roderick Cowie, Maja Pantic

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    190 Citations (Scopus)
    83 Downloads (Pure)

    Abstract

    We have recorded a new corpus of emotionally coloured conversations. Users were recorded while holding conversations with an operator who adopts in sequence four roles designed to evoke emotional reactions. The operator and the user are seated in separate rooms; they see each other through teleprompter screens, and hear each other through speakers. To allow high quality recording, they are recorded by five high-resolution, high framerate cameras, and by four microphones. All sensor information is recorded synchronously, with an accuracy of 25 μs. In total, we have recorded 20 participants, for a total of 100 character conversational and 50 non-conversational recordings of approximately 5 minutes each. All recorded conversations have been fully transcribed and annotated for five affective dimensions and partially annotated for 27 other dimensions. The corpus has been made available to the scientific community through a webaccessible database.
    Original languageUndefined
    Title of host publicationIEEE International Conference on Multimedia and Expo, ICME 2010
    Place of PublicationUSA
    PublisherIEEE Computer Society
    Pages1079-1084
    Number of pages6
    ISBN (Print)978-1-4244-7491-2
    DOIs
    Publication statusPublished - 22 Jul 2010

    Publication series

    Name
    PublisherIEEE Computer Society
    ISSN (Print)1945-7871

    Keywords

    • Emotional Annotations
    • HMI-MI: MULTIMODAL INTERACTIONS
    • Affective Computing
    • Sensitive Artificial Listener
    • IR-75975
    • EC Grant Agreement nr.: FP7/211486
    • Emotional Corpora
    • Multimedia Databases
    • METIS-276358
    • EC Grant Agreement nr.: FP7/231287
    • EWI-19545

    Cite this

    McKeown, G., Valstar, M. F., Cowie, R., & Pantic, M. (2010). The SEMAINE corpus of emotionally coloured character interactions. In IEEE International Conference on Multimedia and Expo, ICME 2010 (pp. 1079-1084). USA: IEEE Computer Society. https://doi.org/10.1109/ICME.2010.5583006