Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses

Khiet P. Truong; Gerben J. Westerhof; Sanne M.A. Lamers; Franciska de Jong; Anneke Sools

doi:10.4230/OASIcs.CMN.2013.310

Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses

Khiet P. Truong, Gerben J. Westerhof, Sanne M.A. Lamers, Franciska de Jong, Anneke Sools

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

3 Citations (Scopus)

44 Downloads (Pure)

Abstract

Audiovisual collections of narratives about war-traumas are rich in descriptions of personal and emotional experiences which can be expressed through verbal and nonverbal means. We complement a commonly used verbal analysis with a nonverbal one to study emotional developments in narratives. Using automatic text, vocal, and facial expression analysis we found that verbal emotional expressions do not correspond much to nonverbal ones. This observation may have important implications for the way narratives traditionally are being studied. We aim to understand how different modes of narrative expression relate to each other, and to enrich digital audiovisual interview collections with emotion-oriented tags.

Original language	English
Title of host publication	Proceedings of the Workshop on Computational Models of Narrative, CMN 2013
Place of Publication	Dagstuhl, Germany
Publisher	Dagstuhl
Pages	310-314
Number of pages	5
ISBN (Print)	978-3-939897-57-6
DOIs	https://doi.org/10.4230/OASIcs.CMN.2013.310
Publication status	Published - Aug 2013
Event	2013 Workshop on Computational Models of Narrative, CMN 2013 - Hamburg, Germany Duration: 4 Aug 2013 → 6 Aug 2013 http://narrative.csail.mit.edu/cmn13/

Publication series

Name	Open Access Series in Informatics (OASIcs)
Publisher	Schloss Dagstuhl, Leibniz-Zentrum für Informatik
Volume	32
ISSN (Print)	2190-6807

Conference

Conference	2013 Workshop on Computational Models of Narrative, CMN 2013
Country/Territory	Germany
City	Hamburg
Period	4/08/13 → 6/08/13
Internet address	http://narrative.csail.mit.edu/cmn13/

Keywords

CR-H.3.1
CR-H.3.7
CR-I.2.7
Nonverbal emotional expression
Narrative psychology
Automatic content analysis
Automatic human behavior analysis
Verbal emotional expression

Access to Document

10.4230/OASIcs.CMN.2013.310

Truong2013emotionalFinal published version, 392 KBLicence: CC BY

Cite this

Truong, K. P., Westerhof, G. J., Lamers, S. M. A., de Jong, F., & Sools, A. (2013). Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses. In Proceedings of the Workshop on Computational Models of Narrative, CMN 2013 (pp. 310-314). (Open Access Series in Informatics (OASIcs); Vol. 32). Dagstuhl. https://doi.org/10.4230/OASIcs.CMN.2013.310

@inproceedings{19efc24ef7c043cc9e19d5633326f2a1,

title = "Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses",

abstract = "Audiovisual collections of narratives about war-traumas are rich in descriptions of personal and emotional experiences which can be expressed through verbal and nonverbal means. We complement a commonly used verbal analysis with a nonverbal one to study emotional developments in narratives. Using automatic text, vocal, and facial expression analysis we found that verbal emotional expressions do not correspond much to nonverbal ones. This observation may have important implications for the way narratives traditionally are being studied. We aim to understand how different modes of narrative expression relate to each other, and to enrich digital audiovisual interview collections with emotion-oriented tags.",

keywords = "CR-H.3.1, CR-H.3.7, CR-I.2.7, Nonverbal emotional expression, Narrative psychology, Automatic content analysis, Automatic human behavior analysis, Verbal emotional expression",

author = "Truong, {Khiet P.} and Westerhof, {Gerben J.} and Lamers, {Sanne M.A.} and {de Jong}, Franciska and Anneke Sools",

year = "2013",

month = aug,

doi = "10.4230/OASIcs.CMN.2013.310",

language = "English",

isbn = "978-3-939897-57-6",

series = "Open Access Series in Informatics (OASIcs)",

publisher = "Dagstuhl",

pages = "310--314",

booktitle = "Proceedings of the Workshop on Computational Models of Narrative, CMN 2013",

address = "Germany",

note = "2013 Workshop on Computational Models of Narrative, CMN 2013 ; Conference date: 04-08-2013 Through 06-08-2013",

url = "http://narrative.csail.mit.edu/cmn13/",

}

Truong, KP , Westerhof, GJ, Lamers, SMA, de Jong, F & Sools, A 2013, Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses. in Proceedings of the Workshop on Computational Models of Narrative, CMN 2013. Open Access Series in Informatics (OASIcs), vol. 32, Dagstuhl, Dagstuhl, Germany, pp. 310-314, 2013 Workshop on Computational Models of Narrative, CMN 2013, Hamburg, Germany, 4/08/13. https://doi.org/10.4230/OASIcs.CMN.2013.310

Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses. / Truong, Khiet P.; Westerhof, Gerben J.; Lamers, Sanne M.A. et al.
Proceedings of the Workshop on Computational Models of Narrative, CMN 2013. Dagstuhl, Germany: Dagstuhl, 2013. p. 310-314 (Open Access Series in Informatics (OASIcs); Vol. 32).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Emotional expression in oral history narratives

T2 - 2013 Workshop on Computational Models of Narrative, CMN 2013

AU - Truong, Khiet P.

AU - Westerhof, Gerben J.

AU - Lamers, Sanne M.A.

AU - de Jong, Franciska

AU - Sools, Anneke

PY - 2013/8

Y1 - 2013/8

N2 - Audiovisual collections of narratives about war-traumas are rich in descriptions of personal and emotional experiences which can be expressed through verbal and nonverbal means. We complement a commonly used verbal analysis with a nonverbal one to study emotional developments in narratives. Using automatic text, vocal, and facial expression analysis we found that verbal emotional expressions do not correspond much to nonverbal ones. This observation may have important implications for the way narratives traditionally are being studied. We aim to understand how different modes of narrative expression relate to each other, and to enrich digital audiovisual interview collections with emotion-oriented tags.

AB - Audiovisual collections of narratives about war-traumas are rich in descriptions of personal and emotional experiences which can be expressed through verbal and nonverbal means. We complement a commonly used verbal analysis with a nonverbal one to study emotional developments in narratives. Using automatic text, vocal, and facial expression analysis we found that verbal emotional expressions do not correspond much to nonverbal ones. This observation may have important implications for the way narratives traditionally are being studied. We aim to understand how different modes of narrative expression relate to each other, and to enrich digital audiovisual interview collections with emotion-oriented tags.

KW - CR-H.3.1

KW - CR-H.3.7

KW - CR-I.2.7

KW - Nonverbal emotional expression

KW - Narrative psychology

KW - Automatic content analysis

KW - Automatic human behavior analysis

KW - Verbal emotional expression

U2 - 10.4230/OASIcs.CMN.2013.310

DO - 10.4230/OASIcs.CMN.2013.310

M3 - Conference contribution

SN - 978-3-939897-57-6

T3 - Open Access Series in Informatics (OASIcs)

SP - 310

EP - 314

BT - Proceedings of the Workshop on Computational Models of Narrative, CMN 2013

PB - Dagstuhl

CY - Dagstuhl, Germany

Y2 - 4 August 2013 through 6 August 2013

ER -

Truong KP , Westerhof GJ, Lamers SMA, de Jong F, Sools A. Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses. In Proceedings of the Workshop on Computational Models of Narrative, CMN 2013. Dagstuhl, Germany: Dagstuhl. 2013. p. 310-314. (Open Access Series in Informatics (OASIcs)). doi: 10.4230/OASIcs.CMN.2013.310

Emotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses

Abstract

Publication series

Conference

Keywords

Access to Document

Fingerprint

Cite this