Continuous Interaction with a Virtual Human

Dennis Reidsma, A.A. Salah (Editor), T. Gevers (Editor), I.A. de Kok, Daniel Neiberg, Sathish Chandra Pammi, B. van Straalen, Khiet Phuong Truong, H. van Welbergen

Research output: Contribution to journalArticleAcademicpeer-review

17 Citations (Scopus)
40 Downloads (Pure)

Abstract

This paper presents our progress in developing a Virtual Human capable of being an attentive speaker. Such a Virtual Human should be able to attend to its interaction partner while it is speaking—and modify its communicative behavior on-the-fly based on what it observes in the behavior of its partner. We report new developments concerning a number of aspects, such as scheduling and interrupting multimodal behavior, automatic classification of listener responses, generation of response eliciting behavior, and strategies for generating appropriate reactions to listener responses. On the basis of this progress, a task-based setup for a responsive Virtual Human was implemented to carry out two user studies, the results of which are presented and discussed in this paper.
Original languageUndefined
Pages (from-to)97-118
Number of pages22
JournalJournal on multimodal user interfaces
Volume4
Issue number2
DOIs
Publication statusPublished - 2011

Keywords

  • EWI-20355
  • METIS-277727
  • IR-77798
  • Virtual Humans
  • Attentive Speaking
  • Listener Responses
  • Continuous Interaction

Cite this

Reidsma, D., Salah, A. A. (Ed.), Gevers, T. (Ed.), de Kok, I. A., Neiberg, D., Pammi, S. C., ... van Welbergen, H. (2011). Continuous Interaction with a Virtual Human. Journal on multimodal user interfaces, 4(2), 97-118. https://doi.org/10.1007/s12193-011-0060-x
Reidsma, Dennis ; Salah, A.A. (Editor) ; Gevers, T. (Editor) ; de Kok, I.A. ; Neiberg, Daniel ; Pammi, Sathish Chandra ; van Straalen, B. ; Truong, Khiet Phuong ; van Welbergen, H. / Continuous Interaction with a Virtual Human. In: Journal on multimodal user interfaces. 2011 ; Vol. 4, No. 2. pp. 97-118.
@article{002ba1ff046b4d2d86f821a54b01bdb8,
title = "Continuous Interaction with a Virtual Human",
abstract = "This paper presents our progress in developing a Virtual Human capable of being an attentive speaker. Such a Virtual Human should be able to attend to its interaction partner while it is speaking—and modify its communicative behavior on-the-fly based on what it observes in the behavior of its partner. We report new developments concerning a number of aspects, such as scheduling and interrupting multimodal behavior, automatic classification of listener responses, generation of response eliciting behavior, and strategies for generating appropriate reactions to listener responses. On the basis of this progress, a task-based setup for a responsive Virtual Human was implemented to carry out two user studies, the results of which are presented and discussed in this paper.",
keywords = "EWI-20355, METIS-277727, IR-77798, Virtual Humans, Attentive Speaking, Listener Responses, Continuous Interaction",
author = "Dennis Reidsma and A.A. Salah and T. Gevers and {de Kok}, I.A. and Daniel Neiberg and Pammi, {Sathish Chandra} and {van Straalen}, B. and Truong, {Khiet Phuong} and {van Welbergen}, H.",
note = "eemcs-eprint-20355",
year = "2011",
doi = "10.1007/s12193-011-0060-x",
language = "Undefined",
volume = "4",
pages = "97--118",
journal = "Journal on multimodal user interfaces",
issn = "1783-7677",
publisher = "Springer",
number = "2",

}

Reidsma, D, Salah, AA (ed.), Gevers, T (ed.), de Kok, IA, Neiberg, D, Pammi, SC, van Straalen, B, Truong, KP & van Welbergen, H 2011, 'Continuous Interaction with a Virtual Human' Journal on multimodal user interfaces, vol. 4, no. 2, pp. 97-118. https://doi.org/10.1007/s12193-011-0060-x

Continuous Interaction with a Virtual Human. / Reidsma, Dennis; Salah, A.A. (Editor); Gevers, T. (Editor); de Kok, I.A.; Neiberg, Daniel; Pammi, Sathish Chandra; van Straalen, B.; Truong, Khiet Phuong; van Welbergen, H.

In: Journal on multimodal user interfaces, Vol. 4, No. 2, 2011, p. 97-118.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Continuous Interaction with a Virtual Human

AU - Reidsma, Dennis

AU - de Kok, I.A.

AU - Neiberg, Daniel

AU - Pammi, Sathish Chandra

AU - van Straalen, B.

AU - Truong, Khiet Phuong

AU - van Welbergen, H.

A2 - Salah, A.A.

A2 - Gevers, T.

N1 - eemcs-eprint-20355

PY - 2011

Y1 - 2011

N2 - This paper presents our progress in developing a Virtual Human capable of being an attentive speaker. Such a Virtual Human should be able to attend to its interaction partner while it is speaking—and modify its communicative behavior on-the-fly based on what it observes in the behavior of its partner. We report new developments concerning a number of aspects, such as scheduling and interrupting multimodal behavior, automatic classification of listener responses, generation of response eliciting behavior, and strategies for generating appropriate reactions to listener responses. On the basis of this progress, a task-based setup for a responsive Virtual Human was implemented to carry out two user studies, the results of which are presented and discussed in this paper.

AB - This paper presents our progress in developing a Virtual Human capable of being an attentive speaker. Such a Virtual Human should be able to attend to its interaction partner while it is speaking—and modify its communicative behavior on-the-fly based on what it observes in the behavior of its partner. We report new developments concerning a number of aspects, such as scheduling and interrupting multimodal behavior, automatic classification of listener responses, generation of response eliciting behavior, and strategies for generating appropriate reactions to listener responses. On the basis of this progress, a task-based setup for a responsive Virtual Human was implemented to carry out two user studies, the results of which are presented and discussed in this paper.

KW - EWI-20355

KW - METIS-277727

KW - IR-77798

KW - Virtual Humans

KW - Attentive Speaking

KW - Listener Responses

KW - Continuous Interaction

U2 - 10.1007/s12193-011-0060-x

DO - 10.1007/s12193-011-0060-x

M3 - Article

VL - 4

SP - 97

EP - 118

JO - Journal on multimodal user interfaces

JF - Journal on multimodal user interfaces

SN - 1783-7677

IS - 2

ER -

Reidsma D, Salah AA, (ed.), Gevers T, (ed.), de Kok IA, Neiberg D, Pammi SC et al. Continuous Interaction with a Virtual Human. Journal on multimodal user interfaces. 2011;4(2):97-118. https://doi.org/10.1007/s12193-011-0060-x