Measuring Multimodal Synchrony for Human-Computer Interaction

Dennis Reidsma; Antinus Nijholt; Wolfgang Tschacher; Fabian Ramseyer

doi:10.1109/CW.2010.21

Measuring Multimodal Synchrony for Human-Computer Interaction

Dennis Reidsma, Antinus Nijholt, Wolfgang Tschacher, Fabian Ramseyer

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

26 Citations (Scopus)

261 Downloads (Pure)

Abstract

Nonverbal synchrony is an important and natural element in human-human interaction. It can also play various roles in human-computer interaction. In particular this is the case in the interaction between humans and the virtual humans that inhabit our cyberworlds. Virtual humans need to adapt their behavior to the behavior of their human interaction partners in order to maintain a natural and continuous interaction synchronization. This paper surveys approaches to modeling synchronization and applications where this modeling is important. Apart from presenting this framework, we also present a quantitative method for measuring the level of nonverbal synchrony in an interaction and observations on future research that allows embedding such methods in models of interaction behavior of virtual humans.

Original language	Undefined
Title of host publication	Proceedings of the International Conference on CYBERWORLDS 2010
Editors	A. Sourin
Place of Publication	Los Alamitos
Publisher	IEEE
Pages	67-71
Number of pages	5
ISBN (Print)	978-0-7695-4215-7
DOIs	https://doi.org/10.1109/CW.2010.21
Publication status	Published - 20 Oct 2010
Event	International Conference on CYBERWORLDS 2010 - Singapore Duration: 20 Oct 2010 → 22 Oct 2010

Publication series

Name
Publisher	IEEE Computer Society Press

Conference

Conference	International Conference on CYBERWORLDS 2010
Period	20/10/10 → 22/10/10
Other	20-22 Oct 2010

Keywords

METIS-270868
IR-74052
HMI-HF: Human Factors
HMI-MI: MULTIMODAL INTERACTIONS
EWI-18058

Access to Document

10.1109/CW.2010.21

Cite this

@inproceedings{28e8b895a9ab460fbc8ca18014e0d606,

title = "Measuring Multimodal Synchrony for Human-Computer Interaction",

abstract = "Nonverbal synchrony is an important and natural element in human-human interaction. It can also play various roles in human-computer interaction. In particular this is the case in the interaction between humans and the virtual humans that inhabit our cyberworlds. Virtual humans need to adapt their behavior to the behavior of their human interaction partners in order to maintain a natural and continuous interaction synchronization. This paper surveys approaches to modeling synchronization and applications where this modeling is important. Apart from presenting this framework, we also present a quantitative method for measuring the level of nonverbal synchrony in an interaction and observations on future research that allows embedding such methods in models of interaction behavior of virtual humans.",

keywords = "METIS-270868, IR-74052, HMI-HF: Human Factors, HMI-MI: MULTIMODAL INTERACTIONS, EWI-18058",

author = "Dennis Reidsma and Antinus Nijholt and Wolfgang Tschacher and Fabian Ramseyer",

note = "Synchrony, nonverbal communication, measurement, virtual humans, HCI; International Conference on CYBERWORLDS 2010 ; Conference date: 20-10-2010 Through 22-10-2010",

year = "2010",

month = oct,

day = "20",

doi = "10.1109/CW.2010.21",

language = "Undefined",

isbn = "978-0-7695-4215-7",

publisher = "IEEE",

pages = "67--71",

editor = "A. Sourin",

booktitle = "Proceedings of the International Conference on CYBERWORLDS 2010",

address = "United States",

}

TY - GEN

T1 - Measuring Multimodal Synchrony for Human-Computer Interaction

AU - Reidsma, Dennis

AU - Nijholt, Antinus

AU - Tschacher, Wolfgang

AU - Ramseyer, Fabian

N1 - Synchrony, nonverbal communication, measurement, virtual humans, HCI

PY - 2010/10/20

Y1 - 2010/10/20

N2 - Nonverbal synchrony is an important and natural element in human-human interaction. It can also play various roles in human-computer interaction. In particular this is the case in the interaction between humans and the virtual humans that inhabit our cyberworlds. Virtual humans need to adapt their behavior to the behavior of their human interaction partners in order to maintain a natural and continuous interaction synchronization. This paper surveys approaches to modeling synchronization and applications where this modeling is important. Apart from presenting this framework, we also present a quantitative method for measuring the level of nonverbal synchrony in an interaction and observations on future research that allows embedding such methods in models of interaction behavior of virtual humans.

AB - Nonverbal synchrony is an important and natural element in human-human interaction. It can also play various roles in human-computer interaction. In particular this is the case in the interaction between humans and the virtual humans that inhabit our cyberworlds. Virtual humans need to adapt their behavior to the behavior of their human interaction partners in order to maintain a natural and continuous interaction synchronization. This paper surveys approaches to modeling synchronization and applications where this modeling is important. Apart from presenting this framework, we also present a quantitative method for measuring the level of nonverbal synchrony in an interaction and observations on future research that allows embedding such methods in models of interaction behavior of virtual humans.

KW - METIS-270868

KW - IR-74052

KW - HMI-HF: Human Factors

KW - HMI-MI: MULTIMODAL INTERACTIONS

KW - EWI-18058

U2 - 10.1109/CW.2010.21

DO - 10.1109/CW.2010.21

M3 - Conference contribution

SN - 978-0-7695-4215-7

SP - 67

EP - 71

BT - Proceedings of the International Conference on CYBERWORLDS 2010

A2 - Sourin, A.

PB - IEEE

CY - Los Alamitos

T2 - International Conference on CYBERWORLDS 2010

Y2 - 20 October 2010 through 22 October 2010

ER -