Dimensional Emotion Recognition from Spontaneous Head Gestures for Interaction with Sensitive Artificial Listeners

Hatice Gunes; Maja Pantic

doi:10.1007/978-3-642-15892-6_39

Dimensional Emotion Recognition from Spontaneous Head Gestures for Interaction with Sensitive Artificial Listeners

Hatice Gunes, Maja Pantic

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

72 Citations (Scopus)

6 Downloads (Pure)

Abstract

This paper focuses on dimensional prediction of emotions from spontaneous conversational head gestures. It maps the amount and direction of head motion, and occurrences of head nods and shakes into arousal, expectation, intensity, power and valence level of the observed subject as there has been virtually no research bearing on this topic. Preliminary experiments show that it is possible to automatically predict emotions in terms of these five dimensions (arousal, expectation, intensity, power and valence) from conversational head gestures. Dimensional and continuous emotion prediction from spontaneous head gestures has been integrated in the SEMAINE project [1] that aims to achieve sustained emotionally-colored interaction between a human user and Sensitive Artificial Listeners

Original language	Undefined
Title of host publication	Proceedings of the 10th International Conference on Intelligent Virtual Agents, IVA 2010
Editors	Jan Allbeck, Norman Badler, Timothy Bickmore, Catherine Pelachaud, Alla Safonova
Place of Publication	Berlin
Publisher	Springer
Pages	371-377
Number of pages	7
ISBN (Print)	978-3-642-15892-6
DOIs	https://doi.org/10.1007/978-3-642-15892-6_39 https://doi.org/10.1007/978-3-642-15892-6
Publication status	Published - 21 Sept 2010
Event	10th International Conference on Intelligent Virtual Agents, IVA 2010 - Philadelphia, United States Duration: 20 Sept 2010 → 22 Sept 2010 Conference number: 10

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer Verlag
Volume	6356

Conference

Conference	10th International Conference on Intelligent Virtual Agents, IVA 2010
Abbreviated title	IVA
Country/Territory	United States
City	Philadelphia
Period	20/09/10 → 22/09/10

Keywords

IR-75933
METIS-275891
Spontaneous head movements
HMI-MI: MULTIMODAL INTERACTIONS
virtual character-human interaction
EWI-19479
dimensional emotion prediction
EC Grant Agreement nr.: FP7/211486

Access to Document

http://eprints.eemcs.utwente.nl/secure2/19479/01/pantic_dimensional_emotion_prediction_from.pdf

Cite this

Gunes, H., & Pantic, M. (2010). Dimensional Emotion Recognition from Spontaneous Head Gestures for Interaction with Sensitive Artificial Listeners. In J. Allbeck, N. Badler, T. Bickmore, C. Pelachaud, & A. Safonova (Eds.), Proceedings of the 10th International Conference on Intelligent Virtual Agents, IVA 2010 (pp. 371-377). (Lecture Notes in Computer Science; Vol. 6356). Springer. https://doi.org/10.1007/978-3-642-15892-6_39, https://doi.org/10.1007/978-3-642-15892-6

Gunes, Hatice ; Pantic, Maja. / Dimensional Emotion Recognition from Spontaneous Head Gestures for Interaction with Sensitive Artificial Listeners. Proceedings of the 10th International Conference on Intelligent Virtual Agents, IVA 2010. editor / Jan Allbeck ; Norman Badler ; Timothy Bickmore ; Catherine Pelachaud ; Alla Safonova. Berlin : Springer, 2010. pp. 371-377 (Lecture Notes in Computer Science).

@inproceedings{b48cddd4d10f4727b7a1e9e595a334d4,

title = "Dimensional Emotion Recognition from Spontaneous Head Gestures for Interaction with Sensitive Artificial Listeners",

abstract = "This paper focuses on dimensional prediction of emotions from spontaneous conversational head gestures. It maps the amount and direction of head motion, and occurrences of head nods and shakes into arousal, expectation, intensity, power and valence level of the observed subject as there has been virtually no research bearing on this topic. Preliminary experiments show that it is possible to automatically predict emotions in terms of these five dimensions (arousal, expectation, intensity, power and valence) from conversational head gestures. Dimensional and continuous emotion prediction from spontaneous head gestures has been integrated in the SEMAINE project [1] that aims to achieve sustained emotionally-colored interaction between a human user and Sensitive Artificial Listeners",

keywords = "IR-75933, METIS-275891, Spontaneous head movements, HMI-MI: MULTIMODAL INTERACTIONS, virtual character-human interaction, EWI-19479, dimensional emotion prediction, EC Grant Agreement nr.: FP7/211486",

author = "Hatice Gunes and Maja Pantic",

note = "10.1007/978-3-642-15892-6 ; 10th International Conference on Intelligent Virtual Agents, IVA 2010 ; Conference date: 20-09-2010 Through 22-09-2010",

year = "2010",

month = sep,

day = "21",

doi = "10.1007/978-3-642-15892-6_39",

language = "Undefined",

isbn = "978-3-642-15892-6",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "371--377",

editor = "Jan Allbeck and Norman Badler and Timothy Bickmore and Catherine Pelachaud and Alla Safonova",

booktitle = "Proceedings of the 10th International Conference on Intelligent Virtual Agents, IVA 2010",

address = "Germany",

}

Gunes, H & Pantic, M 2010, Dimensional Emotion Recognition from Spontaneous Head Gestures for Interaction with Sensitive Artificial Listeners. in J Allbeck, N Badler, T Bickmore, C Pelachaud & A Safonova (eds), Proceedings of the 10th International Conference on Intelligent Virtual Agents, IVA 2010. Lecture Notes in Computer Science, vol. 6356, Springer, Berlin, pp. 371-377, 10th International Conference on Intelligent Virtual Agents, IVA 2010, Philadelphia, Pennsylvania, United States, 20/09/10. https://doi.org/10.1007/978-3-642-15892-6_39, https://doi.org/10.1007/978-3-642-15892-6

Dimensional Emotion Recognition from Spontaneous Head Gestures for Interaction with Sensitive Artificial Listeners. / Gunes, Hatice; Pantic, Maja.
Proceedings of the 10th International Conference on Intelligent Virtual Agents, IVA 2010. ed. / Jan Allbeck; Norman Badler; Timothy Bickmore; Catherine Pelachaud; Alla Safonova. Berlin: Springer, 2010. p. 371-377 (Lecture Notes in Computer Science; Vol. 6356).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Dimensional Emotion Recognition from Spontaneous Head Gestures for Interaction with Sensitive Artificial Listeners

AU - Gunes, Hatice

AU - Pantic, Maja

N1 - Conference code: 10

PY - 2010/9/21

Y1 - 2010/9/21

N2 - This paper focuses on dimensional prediction of emotions from spontaneous conversational head gestures. It maps the amount and direction of head motion, and occurrences of head nods and shakes into arousal, expectation, intensity, power and valence level of the observed subject as there has been virtually no research bearing on this topic. Preliminary experiments show that it is possible to automatically predict emotions in terms of these five dimensions (arousal, expectation, intensity, power and valence) from conversational head gestures. Dimensional and continuous emotion prediction from spontaneous head gestures has been integrated in the SEMAINE project [1] that aims to achieve sustained emotionally-colored interaction between a human user and Sensitive Artificial Listeners

AB - This paper focuses on dimensional prediction of emotions from spontaneous conversational head gestures. It maps the amount and direction of head motion, and occurrences of head nods and shakes into arousal, expectation, intensity, power and valence level of the observed subject as there has been virtually no research bearing on this topic. Preliminary experiments show that it is possible to automatically predict emotions in terms of these five dimensions (arousal, expectation, intensity, power and valence) from conversational head gestures. Dimensional and continuous emotion prediction from spontaneous head gestures has been integrated in the SEMAINE project [1] that aims to achieve sustained emotionally-colored interaction between a human user and Sensitive Artificial Listeners

KW - IR-75933

KW - METIS-275891

KW - Spontaneous head movements

KW - HMI-MI: MULTIMODAL INTERACTIONS

KW - virtual character-human interaction

KW - EWI-19479

KW - dimensional emotion prediction

KW - EC Grant Agreement nr.: FP7/211486

U2 - 10.1007/978-3-642-15892-6_39

DO - 10.1007/978-3-642-15892-6_39

M3 - Conference contribution

SN - 978-3-642-15892-6

T3 - Lecture Notes in Computer Science

SP - 371

EP - 377

BT - Proceedings of the 10th International Conference on Intelligent Virtual Agents, IVA 2010

A2 - Allbeck, Jan

A2 - Badler, Norman

A2 - Bickmore, Timothy

A2 - Pelachaud, Catherine

A2 - Safonova, Alla

PB - Springer

CY - Berlin

T2 - 10th International Conference on Intelligent Virtual Agents, IVA 2010

Y2 - 20 September 2010 through 22 September 2010

ER -

Gunes H, Pantic M. Dimensional Emotion Recognition from Spontaneous Head Gestures for Interaction with Sensitive Artificial Listeners. In Allbeck J, Badler N, Bickmore T, Pelachaud C, Safonova A, editors, Proceedings of the 10th International Conference on Intelligent Virtual Agents, IVA 2010. Berlin: Springer. 2010. p. 371-377. (Lecture Notes in Computer Science). doi: 10.1007/978-3-642-15892-6_39, 10.1007/978-3-642-15892-6