Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    7 Downloads (Pure)

    Abstract

    Audiovisual collections of narratives about war-traumas are rich in descriptions of personal and emotional experiences which can be expressed through verbal and nonverbal means. We complement a commonly used verbal analysis with a nonverbal one to study emotional developments in narratives. Using automatic text, vocal, and facial expression analysis we found that verbal emotional expressions do not correspond much to nonverbal ones. This observation may have important implications for the way narratives traditionally are being studied. We aim to understand how different modes of narrative expression relate to each other, and to enrich digital audiovisual interview collections with emotion-oriented tags.
    Original languageEnglish
    Title of host publicationProceedings of the Workshop on Computational Models of Narrative, CMN 2013
    Place of PublicationDagstuhl, Germany
    PublisherDagstuhl
    Pages310-314
    Number of pages5
    ISBN (Print)978-3-939897-57-6
    DOIs
    Publication statusPublished - Aug 2013
    Event2013 Workshop on Computational Models of Narrative, CMN 2013 - Hamburg, Germany
    Duration: 4 Aug 20136 Aug 2013
    http://narrative.csail.mit.edu/cmn13/

    Publication series

    NameOpen Access Series in Informatics (OASIcs)
    PublisherSchloss Dagstuhl, Leibniz-Zentrum für Informatik
    Volume32
    ISSN (Print)2190-6807

    Conference

    Conference2013 Workshop on Computational Models of Narrative, CMN 2013
    CountryGermany
    CityHamburg
    Period4/08/136/08/13
    Internet address

    Fingerprint

    oral history
    narrative
    emotional development
    facial expression
    trauma
    emotion
    interview
    experience

    Keywords

    • EWI-23744
    • CR-H.3.1
    • CR-H.3.7
    • CR-I.2.7
    • nonverbal emotional expression
    • narrative psychology
    • automatic content analysis
    • automatic human behavior analysis
    • verbal emotional expression

    Cite this

    Truong, K. P., Westerhof, G. J., Lamers, S. M. A., de Jong, F. M. G., & Sools, A. (2013). Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses. In Proceedings of the Workshop on Computational Models of Narrative, CMN 2013 (pp. 310-314). (Open Access Series in Informatics (OASIcs); Vol. 32). Dagstuhl, Germany: Dagstuhl. https://doi.org/10.4230/OASIcs.CMN.2013.310
    Truong, Khiet Phuong ; Westerhof, Gerben Johan ; Lamers, S.M.A. ; de Jong, Franciska M.G. ; Sools, A. / Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses. Proceedings of the Workshop on Computational Models of Narrative, CMN 2013. Dagstuhl, Germany : Dagstuhl, 2013. pp. 310-314 (Open Access Series in Informatics (OASIcs)).
    @inproceedings{19efc24ef7c043cc9e19d5633326f2a1,
    title = "Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses",
    abstract = "Audiovisual collections of narratives about war-traumas are rich in descriptions of personal and emotional experiences which can be expressed through verbal and nonverbal means. We complement a commonly used verbal analysis with a nonverbal one to study emotional developments in narratives. Using automatic text, vocal, and facial expression analysis we found that verbal emotional expressions do not correspond much to nonverbal ones. This observation may have important implications for the way narratives traditionally are being studied. We aim to understand how different modes of narrative expression relate to each other, and to enrich digital audiovisual interview collections with emotion-oriented tags.",
    keywords = "EWI-23744, CR-H.3.1, CR-H.3.7, CR-I.2.7, nonverbal emotional expression, narrative psychology, automatic content analysis, automatic human behavior analysis, verbal emotional expression",
    author = "Truong, {Khiet Phuong} and Westerhof, {Gerben Johan} and S.M.A. Lamers and {de Jong}, {Franciska M.G.} and A. Sools",
    year = "2013",
    month = "8",
    doi = "10.4230/OASIcs.CMN.2013.310",
    language = "English",
    isbn = "978-3-939897-57-6",
    series = "Open Access Series in Informatics (OASIcs)",
    publisher = "Dagstuhl",
    pages = "310--314",
    booktitle = "Proceedings of the Workshop on Computational Models of Narrative, CMN 2013",
    address = "Germany",

    }

    Truong, KP, Westerhof, GJ, Lamers, SMA, de Jong, FMG & Sools, A 2013, Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses. in Proceedings of the Workshop on Computational Models of Narrative, CMN 2013. Open Access Series in Informatics (OASIcs), vol. 32, Dagstuhl, Dagstuhl, Germany, pp. 310-314, 2013 Workshop on Computational Models of Narrative, CMN 2013, Hamburg, Germany, 4/08/13. https://doi.org/10.4230/OASIcs.CMN.2013.310

    Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses. / Truong, Khiet Phuong; Westerhof, Gerben Johan; Lamers, S.M.A.; de Jong, Franciska M.G.; Sools, A.

    Proceedings of the Workshop on Computational Models of Narrative, CMN 2013. Dagstuhl, Germany : Dagstuhl, 2013. p. 310-314 (Open Access Series in Informatics (OASIcs); Vol. 32).

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    TY - GEN

    T1 - Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses

    AU - Truong, Khiet Phuong

    AU - Westerhof, Gerben Johan

    AU - Lamers, S.M.A.

    AU - de Jong, Franciska M.G.

    AU - Sools, A.

    PY - 2013/8

    Y1 - 2013/8

    N2 - Audiovisual collections of narratives about war-traumas are rich in descriptions of personal and emotional experiences which can be expressed through verbal and nonverbal means. We complement a commonly used verbal analysis with a nonverbal one to study emotional developments in narratives. Using automatic text, vocal, and facial expression analysis we found that verbal emotional expressions do not correspond much to nonverbal ones. This observation may have important implications for the way narratives traditionally are being studied. We aim to understand how different modes of narrative expression relate to each other, and to enrich digital audiovisual interview collections with emotion-oriented tags.

    AB - Audiovisual collections of narratives about war-traumas are rich in descriptions of personal and emotional experiences which can be expressed through verbal and nonverbal means. We complement a commonly used verbal analysis with a nonverbal one to study emotional developments in narratives. Using automatic text, vocal, and facial expression analysis we found that verbal emotional expressions do not correspond much to nonverbal ones. This observation may have important implications for the way narratives traditionally are being studied. We aim to understand how different modes of narrative expression relate to each other, and to enrich digital audiovisual interview collections with emotion-oriented tags.

    KW - EWI-23744

    KW - CR-H.3.1

    KW - CR-H.3.7

    KW - CR-I.2.7

    KW - nonverbal emotional expression

    KW - narrative psychology

    KW - automatic content analysis

    KW - automatic human behavior analysis

    KW - verbal emotional expression

    U2 - 10.4230/OASIcs.CMN.2013.310

    DO - 10.4230/OASIcs.CMN.2013.310

    M3 - Conference contribution

    SN - 978-3-939897-57-6

    T3 - Open Access Series in Informatics (OASIcs)

    SP - 310

    EP - 314

    BT - Proceedings of the Workshop on Computational Models of Narrative, CMN 2013

    PB - Dagstuhl

    CY - Dagstuhl, Germany

    ER -

    Truong KP, Westerhof GJ, Lamers SMA, de Jong FMG, Sools A. Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses. In Proceedings of the Workshop on Computational Models of Narrative, CMN 2013. Dagstuhl, Germany: Dagstuhl. 2013. p. 310-314. (Open Access Series in Informatics (OASIcs)). https://doi.org/10.4230/OASIcs.CMN.2013.310