Come and have an emotional workout with sensitive artificial listeners!

Marc Schröder; Sathish Pammi; Hatice Gunes; Maja Pantic; Michel F. Valstar; Roddy Cowie; Gary McKeown; Dirk K.J. Heylen; Mark ter Maat; Florian Eyben; Björn Schuller; Martin Wölmmer; Elisabetta Bevacqua; Catherine Pelachaud; Etienne de Sevin

doi:10.1109/FG.2011.5771472

Come and have an emotional workout with sensitive artificial listeners!

Marc Schröder, Sathish Pammi, Hatice Gunes, Maja Pantic, Michel F. Valstar, Roddy Cowie, Gary McKeown, Dirk K.J. Heylen, Mark ter Maat, Florian Eyben, Björn Schuller, Martin Wölmmer, Elisabetta Bevacqua, Catherine Pelachaud, Etienne de Sevin

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

3 Citations (Scopus)

Abstract

This demonstration aims to showcase the recently completed SEMAINE system. The SEMAINE system is a publicly available, fully autonomous Sensitive Artificial Listeners (SAL) system that consists of virtual dialog partners based on audiovisual analysis and synthesis (see http://semaine.opendfki.de/wiki). The system runs in real-time, and combines incremental analysis of user behavior, dialog management, and synthesis of speaker and listener behavior of a SAL character, displayed as a virtual agent. The SAL characters intend to engage the user in a conversation by paying attention to the user's emotions and nonverbal expressions. The characters have their own emotionally defined personality. During an interaction, the characters attempt to create an emotional workout for the user by drawing her/him towards their dominant emotion, through a combination of verbal and nonverbal expressions.

Original language	Undefined
Title of host publication	IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011)
Place of Publication	USA
Publisher	IEEE Computer Society
Pages	646-646
Number of pages	1
ISBN (Print)	978-1-4244-9140-7
DOIs	https://doi.org/10.1109/FG.2011.5771472
Publication status	Published - Mar 2011
Event	9th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2011 - Santa Barbara, United States Duration: 21 Mar 2011 → 25 Mar 2011 Conference number: 9

Publication series

Name
Publisher	IEEE Computer Society

Conference

Conference	9th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2011
Abbreviated title	FG
Country/Territory	United States
City	Santa Barbara
Period	21/03/11 → 25/03/11

Keywords

METIS-285104
Buildings
IR-79613
Real time systems
Face
HMI-IA: Intelligent Agents
Europe
Adaptive Systems
EWI-21455
EC Grant Agreement nr.: FP7/211486
Operating systems
Humans

Access to Document

10.1109/FG.2011.5771472

http://eprints.eemcs.utwente.nl/secure2/21455/01/05771472.pdf

Cite this

Schröder, M., Pammi, S., Gunes, H., Pantic, M., Valstar, M. F., Cowie, R., McKeown, G., Heylen, D. K. J., ter Maat, M., Eyben, F., Schuller, B., Wölmmer, M., Bevacqua, E., Pelachaud, C., & de Sevin, E. (2011). Come and have an emotional workout with sensitive artificial listeners! In IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011) (pp. 646-646). IEEE Computer Society. https://doi.org/10.1109/FG.2011.5771472

@inproceedings{ff17e28d2f824bddb6d721ef52b377fe,

title = "Come and have an emotional workout with sensitive artificial listeners!",

abstract = "This demonstration aims to showcase the recently completed SEMAINE system. The SEMAINE system is a publicly available, fully autonomous Sensitive Artificial Listeners (SAL) system that consists of virtual dialog partners based on audiovisual analysis and synthesis (see http://semaine.opendfki.de/wiki). The system runs in real-time, and combines incremental analysis of user behavior, dialog management, and synthesis of speaker and listener behavior of a SAL character, displayed as a virtual agent. The SAL characters intend to engage the user in a conversation by paying attention to the user's emotions and nonverbal expressions. The characters have their own emotionally defined personality. During an interaction, the characters attempt to create an emotional workout for the user by drawing her/him towards their dominant emotion, through a combination of verbal and nonverbal expressions.",

keywords = "METIS-285104, Buildings, IR-79613, Real time systems, Face, HMI-IA: Intelligent Agents, Europe, Adaptive Systems, EWI-21455, EC Grant Agreement nr.: FP7/211486, Operating systems, Humans",

author = "Marc Schr{\"o}der and Sathish Pammi and Hatice Gunes and Maja Pantic and Valstar, {Michel F.} and Roddy Cowie and Gary McKeown and Heylen, {Dirk K.J.} and {ter Maat}, Mark and Florian Eyben and Bj{\"o}rn Schuller and Martin W{\"o}lmmer and Elisabetta Bevacqua and Catherine Pelachaud and {de Sevin}, Etienne",

note = "10.1109/FG.2011.5771472 ; null ; Conference date: 21-03-2011 Through 25-03-2011",

year = "2011",

month = mar,

doi = "10.1109/FG.2011.5771472",

language = "Undefined",

isbn = "978-1-4244-9140-7",

publisher = "IEEE Computer Society",

pages = "646--646",

booktitle = "IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011)",

address = "United States",

}

Schröder, M, Pammi, S, Gunes, H, Pantic, M, Valstar, MF, Cowie, R, McKeown, G, Heylen, DKJ, ter Maat, M, Eyben, F, Schuller, B, Wölmmer, M, Bevacqua, E, Pelachaud, C & de Sevin, E 2011, Come and have an emotional workout with sensitive artificial listeners! in IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011). IEEE Computer Society, USA, pp. 646-646, 9th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2011, Santa Barbara, California, United States, 21/03/11. https://doi.org/10.1109/FG.2011.5771472

Come and have an emotional workout with sensitive artificial listeners! / Schröder, Marc; Pammi, Sathish; Gunes, Hatice et al.

IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011). USA : IEEE Computer Society, 2011. p. 646-646.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Come and have an emotional workout with sensitive artificial listeners!

AU - Schröder, Marc

AU - Pammi, Sathish

AU - Gunes, Hatice

AU - Pantic, Maja

AU - Valstar, Michel F.

AU - Cowie, Roddy

AU - McKeown, Gary

AU - Heylen, Dirk K.J.

AU - ter Maat, Mark

AU - Eyben, Florian

AU - Schuller, Björn

AU - Wölmmer, Martin

AU - Bevacqua, Elisabetta

AU - Pelachaud, Catherine

AU - de Sevin, Etienne

N1 - Conference code: 9

PY - 2011/3

Y1 - 2011/3

N2 - This demonstration aims to showcase the recently completed SEMAINE system. The SEMAINE system is a publicly available, fully autonomous Sensitive Artificial Listeners (SAL) system that consists of virtual dialog partners based on audiovisual analysis and synthesis (see http://semaine.opendfki.de/wiki). The system runs in real-time, and combines incremental analysis of user behavior, dialog management, and synthesis of speaker and listener behavior of a SAL character, displayed as a virtual agent. The SAL characters intend to engage the user in a conversation by paying attention to the user's emotions and nonverbal expressions. The characters have their own emotionally defined personality. During an interaction, the characters attempt to create an emotional workout for the user by drawing her/him towards their dominant emotion, through a combination of verbal and nonverbal expressions.

AB - This demonstration aims to showcase the recently completed SEMAINE system. The SEMAINE system is a publicly available, fully autonomous Sensitive Artificial Listeners (SAL) system that consists of virtual dialog partners based on audiovisual analysis and synthesis (see http://semaine.opendfki.de/wiki). The system runs in real-time, and combines incremental analysis of user behavior, dialog management, and synthesis of speaker and listener behavior of a SAL character, displayed as a virtual agent. The SAL characters intend to engage the user in a conversation by paying attention to the user's emotions and nonverbal expressions. The characters have their own emotionally defined personality. During an interaction, the characters attempt to create an emotional workout for the user by drawing her/him towards their dominant emotion, through a combination of verbal and nonverbal expressions.

KW - METIS-285104

KW - Buildings

KW - IR-79613

KW - Real time systems

KW - Face

KW - HMI-IA: Intelligent Agents

KW - Europe

KW - Adaptive Systems

KW - EWI-21455

KW - EC Grant Agreement nr.: FP7/211486

KW - Operating systems

KW - Humans

U2 - 10.1109/FG.2011.5771472

DO - 10.1109/FG.2011.5771472

M3 - Conference contribution

SN - 978-1-4244-9140-7

SP - 646

EP - 646

BT - IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011)

PB - IEEE Computer Society

CY - USA

Y2 - 21 March 2011 through 25 March 2011

ER -