The SEMAINE corpus of emotionally coloured character interactions

Gary McKeown, Michel F. Valstar, Roderick Cowie, Maja Pantic

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    190 Citations (Scopus)
    83 Downloads (Pure)


    We have recorded a new corpus of emotionally coloured conversations. Users were recorded while holding conversations with an operator who adopts in sequence four roles designed to evoke emotional reactions. The operator and the user are seated in separate rooms; they see each other through teleprompter screens, and hear each other through speakers. To allow high quality recording, they are recorded by five high-resolution, high framerate cameras, and by four microphones. All sensor information is recorded synchronously, with an accuracy of 25 μs. In total, we have recorded 20 participants, for a total of 100 character conversational and 50 non-conversational recordings of approximately 5 minutes each. All recorded conversations have been fully transcribed and annotated for five affective dimensions and partially annotated for 27 other dimensions. The corpus has been made available to the scientific community through a webaccessible database.
    Original languageUndefined
    Title of host publicationIEEE International Conference on Multimedia and Expo, ICME 2010
    Place of PublicationUSA
    PublisherIEEE Computer Society
    Number of pages6
    ISBN (Print)978-1-4244-7491-2
    Publication statusPublished - 22 Jul 2010

    Publication series

    PublisherIEEE Computer Society
    ISSN (Print)1945-7871


    • Emotional Annotations
    • Affective Computing
    • Sensitive Artificial Listener
    • IR-75975
    • EC Grant Agreement nr.: FP7/211486
    • Emotional Corpora
    • Multimedia Databases
    • METIS-276358
    • EC Grant Agreement nr.: FP7/231287
    • EWI-19545

    Cite this

    McKeown, G., Valstar, M. F., Cowie, R., & Pantic, M. (2010). The SEMAINE corpus of emotionally coloured character interactions. In IEEE International Conference on Multimedia and Expo, ICME 2010 (pp. 1079-1084). USA: IEEE Computer Society.