Differences in head orientation behavior for speakers and listeners: An experiment in a virtual environment

R.J. Rienks, Ronald Walter Poppe, Dirk K.J. Heylen

Research output: Contribution to journalArticleAcademicpeer-review

11 Citations (Scopus)
23 Downloads (Pure)

Abstract

An experiment was conducted to investigate whether human observers use knowledge of the differences in focus of attention in multiparty interaction to identify the speaker amongst the meeting participants. A virtual environment was used to have good stimulus control. Head orientations were displayed as the only cue for focus attention. The orientations were derived from a corpus of tracked head movements. We present some properties of the relation between head orientations and speaker–listener status, as found in the corpus. With respect to the experiment, it appears that people use knowledge of the patterns in focus of attention to distinguish the speaker from the listeners. However, the human speaker identification results were rather low. Head orientations (or focus of attention) alone do not provide a sufficient cue for reliable identification of the speaker in a multiparty setting.
Original languageUndefined
Article number10.1145/1658349.1658351
Pages (from-to)2:1-2:13
Number of pages13
JournalACM transactions on applied perception
Volume7
Issue number1
DOIs
Publication statusPublished - Jan 2010

Keywords

  • EWI-17246
  • HMI-IA: Intelligent Agents
  • HMI-VRG: Virtual Reality and Graphics
  • multiparty conversation
  • gaze behavior
  • IR-69695
  • perception of gaze
  • virtual environments
  • EC Grant Agreement nr.: FP6/033812
  • Head orientation
  • METIS-277395
  • focus of attention

Cite this

@article{1e13e3b74b1048d788b9483dba863138,
title = "Differences in head orientation behavior for speakers and listeners: An experiment in a virtual environment",
abstract = "An experiment was conducted to investigate whether human observers use knowledge of the differences in focus of attention in multiparty interaction to identify the speaker amongst the meeting participants. A virtual environment was used to have good stimulus control. Head orientations were displayed as the only cue for focus attention. The orientations were derived from a corpus of tracked head movements. We present some properties of the relation between head orientations and speaker–listener status, as found in the corpus. With respect to the experiment, it appears that people use knowledge of the patterns in focus of attention to distinguish the speaker from the listeners. However, the human speaker identification results were rather low. Head orientations (or focus of attention) alone do not provide a sufficient cue for reliable identification of the speaker in a multiparty setting.",
keywords = "EWI-17246, HMI-IA: Intelligent Agents, HMI-VRG: Virtual Reality and Graphics, multiparty conversation, gaze behavior, IR-69695, perception of gaze, virtual environments, EC Grant Agreement nr.: FP6/033812, Head orientation, METIS-277395, focus of attention",
author = "R.J. Rienks and Poppe, {Ronald Walter} and Heylen, {Dirk K.J.}",
note = "10.1145/1658349.1658351",
year = "2010",
month = "1",
doi = "10.1145/1658349.1658351",
language = "Undefined",
volume = "7",
pages = "2:1--2:13",
journal = "ACM transactions on applied perception",
issn = "1544-3558",
publisher = "Association for Computing Machinery (ACM)",
number = "1",

}

Differences in head orientation behavior for speakers and listeners: An experiment in a virtual environment. / Rienks, R.J.; Poppe, Ronald Walter; Heylen, Dirk K.J.

In: ACM transactions on applied perception, Vol. 7, No. 1, 10.1145/1658349.1658351, 01.2010, p. 2:1-2:13.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Differences in head orientation behavior for speakers and listeners: An experiment in a virtual environment

AU - Rienks, R.J.

AU - Poppe, Ronald Walter

AU - Heylen, Dirk K.J.

N1 - 10.1145/1658349.1658351

PY - 2010/1

Y1 - 2010/1

N2 - An experiment was conducted to investigate whether human observers use knowledge of the differences in focus of attention in multiparty interaction to identify the speaker amongst the meeting participants. A virtual environment was used to have good stimulus control. Head orientations were displayed as the only cue for focus attention. The orientations were derived from a corpus of tracked head movements. We present some properties of the relation between head orientations and speaker–listener status, as found in the corpus. With respect to the experiment, it appears that people use knowledge of the patterns in focus of attention to distinguish the speaker from the listeners. However, the human speaker identification results were rather low. Head orientations (or focus of attention) alone do not provide a sufficient cue for reliable identification of the speaker in a multiparty setting.

AB - An experiment was conducted to investigate whether human observers use knowledge of the differences in focus of attention in multiparty interaction to identify the speaker amongst the meeting participants. A virtual environment was used to have good stimulus control. Head orientations were displayed as the only cue for focus attention. The orientations were derived from a corpus of tracked head movements. We present some properties of the relation between head orientations and speaker–listener status, as found in the corpus. With respect to the experiment, it appears that people use knowledge of the patterns in focus of attention to distinguish the speaker from the listeners. However, the human speaker identification results were rather low. Head orientations (or focus of attention) alone do not provide a sufficient cue for reliable identification of the speaker in a multiparty setting.

KW - EWI-17246

KW - HMI-IA: Intelligent Agents

KW - HMI-VRG: Virtual Reality and Graphics

KW - multiparty conversation

KW - gaze behavior

KW - IR-69695

KW - perception of gaze

KW - virtual environments

KW - EC Grant Agreement nr.: FP6/033812

KW - Head orientation

KW - METIS-277395

KW - focus of attention

U2 - 10.1145/1658349.1658351

DO - 10.1145/1658349.1658351

M3 - Article

VL - 7

SP - 2:1-2:13

JO - ACM transactions on applied perception

JF - ACM transactions on applied perception

SN - 1544-3558

IS - 1

M1 - 10.1145/1658349.1658351

ER -