Towards affective state modeling in narrative and conversational settings

Bart Jochems; Martha Larson; Roeland J.F. Ordelman; Ronald Walter Poppe; Khiet Phuong Truong

Towards affective state modeling in narrative and conversational settings

Bart Jochems, Martha Larson, Roeland J.F. Ordelman, Ronald Walter Poppe, Khiet Phuong Truong

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

4 Citations (Scopus)

98 Downloads (Pure)

Abstract

We carry out two studies on affective state modeling for communication settings that involve unilateral intent on the part of one participant (the evoker) to shift the affective state of another participant (the experiencer). The first investigates viewer response in a narrative setting using a corpus of documentaries annotated with viewer-reported narrative peaks. The second investigates affective triggers in a conversational setting using a corpus of recorded interactions, annotated with continuous affective ratings, between a human interlocutor and an emotionally colored agent. In each case, we build a "one-sided" model using indicators derived from the speech of one participant. Our classification experiments confirm the viability of our models and provide insight into useful features.

Original language	English
Title of host publication	Proceedings of Interspeech 2010
Publisher	International Speech Communication Association
Pages	490-493
Number of pages	4
ISBN (Print)	1990-9772
Publication status	Published - Sept 2010
Event	11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010 - Makuhari, Chiba, Japan Duration: 26 Sept 2010 → 30 Sept 2010 Conference number: 11 http://www.interspeech2010.jpn.org/

Publication series

Name
Publisher	International Speech Communication Association (ISCA)
ISSN (Print)	1990-9772

Conference

Conference	11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010
Abbreviated title	INTERSPEECH
Country/Territory	Japan
City	Makuhari, Chiba
Period	26/09/10 → 30/09/10
Internet address	http://www.interspeech2010.jpn.org/

Keywords

METIS-271081
IR-74046
HMI-SLT: Speech and Language Technology
EWI-18625
Speech Analysis
Affect recognition

Access to Document

Cite this

@inproceedings{2f97fac5188a4506a97508756fde9823,

title = "Towards affective state modeling in narrative and conversational settings",

abstract = "We carry out two studies on affective state modeling for communication settings that involve unilateral intent on the part of one participant (the evoker) to shift the affective state of another participant (the experiencer). The first investigates viewer response in a narrative setting using a corpus of documentaries annotated with viewer-reported narrative peaks. The second investigates affective triggers in a conversational setting using a corpus of recorded interactions, annotated with continuous affective ratings, between a human interlocutor and an emotionally colored agent. In each case, we build a {"}one-sided{"} model using indicators derived from the speech of one participant. Our classification experiments confirm the viability of our models and provide insight into useful features.",

keywords = "METIS-271081, IR-74046, HMI-SLT: Speech and Language Technology, EWI-18625, Speech Analysis, Affect recognition",

author = "Bart Jochems and Martha Larson and Ordelman, {Roeland J.F.} and Poppe, {Ronald Walter} and Truong, {Khiet Phuong}",

year = "2010",

month = sep,

language = "English",

isbn = "1990-9772",

publisher = "International Speech Communication Association",

pages = "490--493",

booktitle = "Proceedings of Interspeech 2010",

address = "France",

note = "11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010, INTERSPEECH ; Conference date: 26-09-2010 Through 30-09-2010",

url = "http://www.interspeech2010.jpn.org/",

}

TY - GEN

T1 - Towards affective state modeling in narrative and conversational settings

AU - Jochems, Bart

AU - Larson, Martha

AU - Ordelman, Roeland J.F.

AU - Poppe, Ronald Walter

AU - Truong, Khiet Phuong

N1 - Conference code: 11

PY - 2010/9

Y1 - 2010/9

N2 - We carry out two studies on affective state modeling for communication settings that involve unilateral intent on the part of one participant (the evoker) to shift the affective state of another participant (the experiencer). The first investigates viewer response in a narrative setting using a corpus of documentaries annotated with viewer-reported narrative peaks. The second investigates affective triggers in a conversational setting using a corpus of recorded interactions, annotated with continuous affective ratings, between a human interlocutor and an emotionally colored agent. In each case, we build a "one-sided" model using indicators derived from the speech of one participant. Our classification experiments confirm the viability of our models and provide insight into useful features.

AB - We carry out two studies on affective state modeling for communication settings that involve unilateral intent on the part of one participant (the evoker) to shift the affective state of another participant (the experiencer). The first investigates viewer response in a narrative setting using a corpus of documentaries annotated with viewer-reported narrative peaks. The second investigates affective triggers in a conversational setting using a corpus of recorded interactions, annotated with continuous affective ratings, between a human interlocutor and an emotionally colored agent. In each case, we build a "one-sided" model using indicators derived from the speech of one participant. Our classification experiments confirm the viability of our models and provide insight into useful features.

KW - METIS-271081

KW - IR-74046

KW - HMI-SLT: Speech and Language Technology

KW - EWI-18625

KW - Speech Analysis

KW - Affect recognition

M3 - Conference contribution

SN - 1990-9772

SP - 490

EP - 493

BT - Proceedings of Interspeech 2010

PB - International Speech Communication Association

T2 - 11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010

Y2 - 26 September 2010 through 30 September 2010

ER -

Towards affective state modeling in narrative and conversational settings

Abstract

Publication series

Conference

Keywords

Access to Document

Fingerprint

Cite this