Spotting Agreement and Disagreement: A Survey of Nonverbal Audiovisual Cues and Tools

Konstantinos Bousmalis; Marc Mehu; Maja Pantic

doi:10.1109/ACII.2009.5349477

Spotting Agreement and Disagreement: A Survey of Nonverbal Audiovisual Cues and Tools

Konstantinos Bousmalis, Marc Mehu, Maja Pantic

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

50 Citations (Scopus)

37 Downloads (Pure)

Abstract

While detecting and interpreting temporal patterns of non–verbal behavioral cues in a given context is a natural and often unconscious process for humans, it remains a rather difficult task for computer systems. Nevertheless, it is an important one to achieve if the goal is to realise a naturalistic communication between humans and machines. Machines that are able to sense social attitudes like agreement and disagreement and respond to them in a meaningful way are likely to be welcomed by users due to the more natural, efficient and human–centered interaction they are bound to experience. This paper surveys the nonverbal cues that could be present during agreement and disagreement behavioural displays and lists a number of tools that could be useful in detecting them, as well as a few publicly available databases that could be used to train these tools for analysis of spontaneous, audiovisual instances of agreement and disagreement.

Original language	English
Title of host publication	Proceedings 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009
Place of Publication	Los Alamitos, NJ
Publisher	IEEE Computer Society
Pages	1-9
Number of pages	9
Volume	2
ISBN (Print)	978-1-4244-4799-2
DOIs	https://doi.org/10.1109/ACII.2009.5349477
Publication status	Published - Sep 2009
Event	3rd International Conference on Affective Computing and Intelligent Interaction, ACII 2009 - Amsterdam, Netherlands Duration: 10 Sep 2009 → 12 Sep 2009 Conference number: 3

Conference

Conference	3rd International Conference on Affective Computing and Intelligent Interaction, ACII 2009
Abbreviated title	ACII
Country	Netherlands
City	Amsterdam
Period	10/09/09 → 12/09/09

Keywords

METIS-264469
IR-69693
EWI-17180
HMI-HF: Human Factors
EC Grant Agreement nr.: FP7/211486
HMI-MI: MULTIMODAL INTERACTIONS
EC Grant Agreement nr.: FP7/231287

Access to Document

10.1109/ACII.2009.5349477

Fingerprint Dive into the research topics of 'Spotting Agreement and Disagreement: A Survey of Nonverbal Audiovisual Cues and Tools'. Together they form a unique fingerprint.

Cite this

@inproceedings{d751ece74b574021aad783a1e27b7ed1,

title = "Spotting Agreement and Disagreement: A Survey of Nonverbal Audiovisual Cues and Tools",

abstract = "While detecting and interpreting temporal patterns of non–verbal behavioral cues in a given context is a natural and often unconscious process for humans, it remains a rather difficult task for computer systems. Nevertheless, it is an important one to achieve if the goal is to realise a naturalistic communication between humans and machines. Machines that are able to sense social attitudes like agreement and disagreement and respond to them in a meaningful way are likely to be welcomed by users due to the more natural, efficient and human–centered interaction they are bound to experience. This paper surveys the nonverbal cues that could be present during agreement and disagreement behavioural displays and lists a number of tools that could be useful in detecting them, as well as a few publicly available databases that could be used to train these tools for analysis of spontaneous, audiovisual instances of agreement and disagreement.",

keywords = "METIS-264469, IR-69693, EWI-17180, HMI-HF: Human Factors, EC Grant Agreement nr.: FP7/211486, HMI-MI: MULTIMODAL INTERACTIONS, EC Grant Agreement nr.: FP7/231287",

author = "Konstantinos Bousmalis and Marc Mehu and Maja Pantic",

year = "2009",

month = sep,

doi = "10.1109/ACII.2009.5349477",

language = "English",

isbn = "978-1-4244-4799-2",

volume = "2",

pages = "1--9",

booktitle = "Proceedings 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009",

publisher = "IEEE Computer Society",

address = "United States",

note = "3rd International Conference on Affective Computing and Intelligent Interaction, ACII 2009, ACII ; Conference date: 10-09-2009 Through 12-09-2009",

}

Bousmalis, K, Mehu, M & Pantic, M 2009, Spotting Agreement and Disagreement: A Survey of Nonverbal Audiovisual Cues and Tools. in Proceedings 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009. vol. 2, IEEE Computer Society, Los Alamitos, NJ, pp. 1-9, 3rd International Conference on Affective Computing and Intelligent Interaction, ACII 2009, Amsterdam, Netherlands, 10/09/09. https://doi.org/10.1109/ACII.2009.5349477

Spotting Agreement and Disagreement : A Survey of Nonverbal Audiovisual Cues and Tools. / Bousmalis, Konstantinos; Mehu, Marc; Pantic, Maja.

Proceedings 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009. Vol. 2 Los Alamitos, NJ : IEEE Computer Society, 2009. p. 1-9.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Spotting Agreement and Disagreement

T2 - 3rd International Conference on Affective Computing and Intelligent Interaction, ACII 2009

AU - Bousmalis, Konstantinos

AU - Mehu, Marc

AU - Pantic, Maja

N1 - Conference code: 3

PY - 2009/9

Y1 - 2009/9

N2 - While detecting and interpreting temporal patterns of non–verbal behavioral cues in a given context is a natural and often unconscious process for humans, it remains a rather difficult task for computer systems. Nevertheless, it is an important one to achieve if the goal is to realise a naturalistic communication between humans and machines. Machines that are able to sense social attitudes like agreement and disagreement and respond to them in a meaningful way are likely to be welcomed by users due to the more natural, efficient and human–centered interaction they are bound to experience. This paper surveys the nonverbal cues that could be present during agreement and disagreement behavioural displays and lists a number of tools that could be useful in detecting them, as well as a few publicly available databases that could be used to train these tools for analysis of spontaneous, audiovisual instances of agreement and disagreement.

AB - While detecting and interpreting temporal patterns of non–verbal behavioral cues in a given context is a natural and often unconscious process for humans, it remains a rather difficult task for computer systems. Nevertheless, it is an important one to achieve if the goal is to realise a naturalistic communication between humans and machines. Machines that are able to sense social attitudes like agreement and disagreement and respond to them in a meaningful way are likely to be welcomed by users due to the more natural, efficient and human–centered interaction they are bound to experience. This paper surveys the nonverbal cues that could be present during agreement and disagreement behavioural displays and lists a number of tools that could be useful in detecting them, as well as a few publicly available databases that could be used to train these tools for analysis of spontaneous, audiovisual instances of agreement and disagreement.

KW - METIS-264469

KW - IR-69693

KW - EWI-17180

KW - HMI-HF: Human Factors

KW - EC Grant Agreement nr.: FP7/211486

KW - HMI-MI: MULTIMODAL INTERACTIONS

KW - EC Grant Agreement nr.: FP7/231287

U2 - 10.1109/ACII.2009.5349477

DO - 10.1109/ACII.2009.5349477

M3 - Conference contribution

SN - 978-1-4244-4799-2

VL - 2

SP - 1

EP - 9

BT - Proceedings 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009

PB - IEEE Computer Society

CY - Los Alamitos, NJ

Y2 - 10 September 2009 through 12 September 2009

ER -