The SEMAINE corpus of emotionally coloured character interactions

Gary McKeown, Michel F. Valstar, Roderick Cowie, Maja Pantic

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    180 Citations (Scopus)
    65 Downloads (Pure)

    Abstract

    We have recorded a new corpus of emotionally coloured conversations. Users were recorded while holding conversations with an operator who adopts in sequence four roles designed to evoke emotional reactions. The operator and the user are seated in separate rooms; they see each other through teleprompter screens, and hear each other through speakers. To allow high quality recording, they are recorded by five high-resolution, high framerate cameras, and by four microphones. All sensor information is recorded synchronously, with an accuracy of 25 μs. In total, we have recorded 20 participants, for a total of 100 character conversational and 50 non-conversational recordings of approximately 5 minutes each. All recorded conversations have been fully transcribed and annotated for five affective dimensions and partially annotated for 27 other dimensions. The corpus has been made available to the scientific community through a webaccessible database.
    Original languageUndefined
    Title of host publicationIEEE International Conference on Multimedia and Expo, ICME 2010
    Place of PublicationUSA
    PublisherIEEE Computer Society
    Pages1079-1084
    Number of pages6
    ISBN (Print)978-1-4244-7491-2
    DOIs
    Publication statusPublished - 22 Jul 2010

    Publication series

    Name
    PublisherIEEE Computer Society
    ISSN (Print)1945-7871

    Keywords

    • Emotional Annotations
    • HMI-MI: MULTIMODAL INTERACTIONS
    • Affective Computing
    • Sensitive Artificial Listener
    • IR-75975
    • EC Grant Agreement nr.: FP7/211486
    • Emotional Corpora
    • Multimedia Databases
    • METIS-276358
    • EC Grant Agreement nr.: FP7/231287
    • EWI-19545

    Cite this

    McKeown, G., Valstar, M. F., Cowie, R., & Pantic, M. (2010). The SEMAINE corpus of emotionally coloured character interactions. In IEEE International Conference on Multimedia and Expo, ICME 2010 (pp. 1079-1084). USA: IEEE Computer Society. https://doi.org/10.1109/ICME.2010.5583006
    McKeown, Gary ; Valstar, Michel F. ; Cowie, Roderick ; Pantic, Maja. / The SEMAINE corpus of emotionally coloured character interactions. IEEE International Conference on Multimedia and Expo, ICME 2010. USA : IEEE Computer Society, 2010. pp. 1079-1084
    @inproceedings{f1f6a70a29674972a6576b0ffcea4a29,
    title = "The SEMAINE corpus of emotionally coloured character interactions",
    abstract = "We have recorded a new corpus of emotionally coloured conversations. Users were recorded while holding conversations with an operator who adopts in sequence four roles designed to evoke emotional reactions. The operator and the user are seated in separate rooms; they see each other through teleprompter screens, and hear each other through speakers. To allow high quality recording, they are recorded by five high-resolution, high framerate cameras, and by four microphones. All sensor information is recorded synchronously, with an accuracy of 25 μs. In total, we have recorded 20 participants, for a total of 100 character conversational and 50 non-conversational recordings of approximately 5 minutes each. All recorded conversations have been fully transcribed and annotated for five affective dimensions and partially annotated for 27 other dimensions. The corpus has been made available to the scientific community through a webaccessible database.",
    keywords = "Emotional Annotations, HMI-MI: MULTIMODAL INTERACTIONS, Affective Computing, Sensitive Artificial Listener, IR-75975, EC Grant Agreement nr.: FP7/211486, Emotional Corpora, Multimedia Databases, METIS-276358, EC Grant Agreement nr.: FP7/231287, EWI-19545",
    author = "Gary McKeown and Valstar, {Michel F.} and Roderick Cowie and Maja Pantic",
    note = "10.1109/ICME.2010.5583006",
    year = "2010",
    month = "7",
    day = "22",
    doi = "10.1109/ICME.2010.5583006",
    language = "Undefined",
    isbn = "978-1-4244-7491-2",
    publisher = "IEEE Computer Society",
    pages = "1079--1084",
    booktitle = "IEEE International Conference on Multimedia and Expo, ICME 2010",
    address = "United States",

    }

    McKeown, G, Valstar, MF, Cowie, R & Pantic, M 2010, The SEMAINE corpus of emotionally coloured character interactions. in IEEE International Conference on Multimedia and Expo, ICME 2010. IEEE Computer Society, USA, pp. 1079-1084. https://doi.org/10.1109/ICME.2010.5583006

    The SEMAINE corpus of emotionally coloured character interactions. / McKeown, Gary; Valstar, Michel F.; Cowie, Roderick; Pantic, Maja.

    IEEE International Conference on Multimedia and Expo, ICME 2010. USA : IEEE Computer Society, 2010. p. 1079-1084.

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    TY - GEN

    T1 - The SEMAINE corpus of emotionally coloured character interactions

    AU - McKeown, Gary

    AU - Valstar, Michel F.

    AU - Cowie, Roderick

    AU - Pantic, Maja

    N1 - 10.1109/ICME.2010.5583006

    PY - 2010/7/22

    Y1 - 2010/7/22

    N2 - We have recorded a new corpus of emotionally coloured conversations. Users were recorded while holding conversations with an operator who adopts in sequence four roles designed to evoke emotional reactions. The operator and the user are seated in separate rooms; they see each other through teleprompter screens, and hear each other through speakers. To allow high quality recording, they are recorded by five high-resolution, high framerate cameras, and by four microphones. All sensor information is recorded synchronously, with an accuracy of 25 μs. In total, we have recorded 20 participants, for a total of 100 character conversational and 50 non-conversational recordings of approximately 5 minutes each. All recorded conversations have been fully transcribed and annotated for five affective dimensions and partially annotated for 27 other dimensions. The corpus has been made available to the scientific community through a webaccessible database.

    AB - We have recorded a new corpus of emotionally coloured conversations. Users were recorded while holding conversations with an operator who adopts in sequence four roles designed to evoke emotional reactions. The operator and the user are seated in separate rooms; they see each other through teleprompter screens, and hear each other through speakers. To allow high quality recording, they are recorded by five high-resolution, high framerate cameras, and by four microphones. All sensor information is recorded synchronously, with an accuracy of 25 μs. In total, we have recorded 20 participants, for a total of 100 character conversational and 50 non-conversational recordings of approximately 5 minutes each. All recorded conversations have been fully transcribed and annotated for five affective dimensions and partially annotated for 27 other dimensions. The corpus has been made available to the scientific community through a webaccessible database.

    KW - Emotional Annotations

    KW - HMI-MI: MULTIMODAL INTERACTIONS

    KW - Affective Computing

    KW - Sensitive Artificial Listener

    KW - IR-75975

    KW - EC Grant Agreement nr.: FP7/211486

    KW - Emotional Corpora

    KW - Multimedia Databases

    KW - METIS-276358

    KW - EC Grant Agreement nr.: FP7/231287

    KW - EWI-19545

    U2 - 10.1109/ICME.2010.5583006

    DO - 10.1109/ICME.2010.5583006

    M3 - Conference contribution

    SN - 978-1-4244-7491-2

    SP - 1079

    EP - 1084

    BT - IEEE International Conference on Multimedia and Expo, ICME 2010

    PB - IEEE Computer Society

    CY - USA

    ER -

    McKeown G, Valstar MF, Cowie R, Pantic M. The SEMAINE corpus of emotionally coloured character interactions. In IEEE International Conference on Multimedia and Expo, ICME 2010. USA: IEEE Computer Society. 2010. p. 1079-1084 https://doi.org/10.1109/ICME.2010.5583006