Differences in head orientation behavior for speakers and listeners: An experiment in a virtual environment

R.J. Rienks, Ronald Walter Poppe, Dirk K.J. Heylen

    Research output: Contribution to journalArticleAcademicpeer-review

    11 Citations (Scopus)
    32 Downloads (Pure)

    Abstract

    An experiment was conducted to investigate whether human observers use knowledge of the differences in focus of attention in multiparty interaction to identify the speaker amongst the meeting participants. A virtual environment was used to have good stimulus control. Head orientations were displayed as the only cue for focus attention. The orientations were derived from a corpus of tracked head movements. We present some properties of the relation between head orientations and speaker–listener status, as found in the corpus. With respect to the experiment, it appears that people use knowledge of the patterns in focus of attention to distinguish the speaker from the listeners. However, the human speaker identification results were rather low. Head orientations (or focus of attention) alone do not provide a sufficient cue for reliable identification of the speaker in a multiparty setting.
    Original languageUndefined
    Article number10.1145/1658349.1658351
    Pages (from-to)2:1-2:13
    Number of pages13
    JournalACM transactions on applied perception
    Volume7
    Issue number1
    DOIs
    Publication statusPublished - Jan 2010

    Keywords

    • EWI-17246
    • HMI-IA: Intelligent Agents
    • HMI-VRG: Virtual Reality and Graphics
    • multiparty conversation
    • gaze behavior
    • IR-69695
    • perception of gaze
    • virtual environments
    • EC Grant Agreement nr.: FP6/033812
    • Head orientation
    • METIS-277395
    • focus of attention

    Cite this

    @article{1e13e3b74b1048d788b9483dba863138,
    title = "Differences in head orientation behavior for speakers and listeners: An experiment in a virtual environment",
    abstract = "An experiment was conducted to investigate whether human observers use knowledge of the differences in focus of attention in multiparty interaction to identify the speaker amongst the meeting participants. A virtual environment was used to have good stimulus control. Head orientations were displayed as the only cue for focus attention. The orientations were derived from a corpus of tracked head movements. We present some properties of the relation between head orientations and speaker–listener status, as found in the corpus. With respect to the experiment, it appears that people use knowledge of the patterns in focus of attention to distinguish the speaker from the listeners. However, the human speaker identification results were rather low. Head orientations (or focus of attention) alone do not provide a sufficient cue for reliable identification of the speaker in a multiparty setting.",
    keywords = "EWI-17246, HMI-IA: Intelligent Agents, HMI-VRG: Virtual Reality and Graphics, multiparty conversation, gaze behavior, IR-69695, perception of gaze, virtual environments, EC Grant Agreement nr.: FP6/033812, Head orientation, METIS-277395, focus of attention",
    author = "R.J. Rienks and Poppe, {Ronald Walter} and Heylen, {Dirk K.J.}",
    note = "10.1145/1658349.1658351",
    year = "2010",
    month = "1",
    doi = "10.1145/1658349.1658351",
    language = "Undefined",
    volume = "7",
    pages = "2:1--2:13",
    journal = "ACM transactions on applied perception",
    issn = "1544-3558",
    publisher = "Association for Computing Machinery (ACM)",
    number = "1",

    }

    Differences in head orientation behavior for speakers and listeners: An experiment in a virtual environment. / Rienks, R.J.; Poppe, Ronald Walter; Heylen, Dirk K.J.

    In: ACM transactions on applied perception, Vol. 7, No. 1, 10.1145/1658349.1658351, 01.2010, p. 2:1-2:13.

    Research output: Contribution to journalArticleAcademicpeer-review

    TY - JOUR

    T1 - Differences in head orientation behavior for speakers and listeners: An experiment in a virtual environment

    AU - Rienks, R.J.

    AU - Poppe, Ronald Walter

    AU - Heylen, Dirk K.J.

    N1 - 10.1145/1658349.1658351

    PY - 2010/1

    Y1 - 2010/1

    N2 - An experiment was conducted to investigate whether human observers use knowledge of the differences in focus of attention in multiparty interaction to identify the speaker amongst the meeting participants. A virtual environment was used to have good stimulus control. Head orientations were displayed as the only cue for focus attention. The orientations were derived from a corpus of tracked head movements. We present some properties of the relation between head orientations and speaker–listener status, as found in the corpus. With respect to the experiment, it appears that people use knowledge of the patterns in focus of attention to distinguish the speaker from the listeners. However, the human speaker identification results were rather low. Head orientations (or focus of attention) alone do not provide a sufficient cue for reliable identification of the speaker in a multiparty setting.

    AB - An experiment was conducted to investigate whether human observers use knowledge of the differences in focus of attention in multiparty interaction to identify the speaker amongst the meeting participants. A virtual environment was used to have good stimulus control. Head orientations were displayed as the only cue for focus attention. The orientations were derived from a corpus of tracked head movements. We present some properties of the relation between head orientations and speaker–listener status, as found in the corpus. With respect to the experiment, it appears that people use knowledge of the patterns in focus of attention to distinguish the speaker from the listeners. However, the human speaker identification results were rather low. Head orientations (or focus of attention) alone do not provide a sufficient cue for reliable identification of the speaker in a multiparty setting.

    KW - EWI-17246

    KW - HMI-IA: Intelligent Agents

    KW - HMI-VRG: Virtual Reality and Graphics

    KW - multiparty conversation

    KW - gaze behavior

    KW - IR-69695

    KW - perception of gaze

    KW - virtual environments

    KW - EC Grant Agreement nr.: FP6/033812

    KW - Head orientation

    KW - METIS-277395

    KW - focus of attention

    U2 - 10.1145/1658349.1658351

    DO - 10.1145/1658349.1658351

    M3 - Article

    VL - 7

    SP - 2:1-2:13

    JO - ACM transactions on applied perception

    JF - ACM transactions on applied perception

    SN - 1544-3558

    IS - 1

    M1 - 10.1145/1658349.1658351

    ER -