Multimodal plan representation for adaptable BML scheduling

H. van Welbergen, Dennis Reidsma, Jakob Zwiers

Research output: Contribution to journalArticleAcademicpeer-review

2 Citations (Scopus)

Abstract

Natural human interaction is characterized by interpersonal coordination: interlocutors converge in their speech rates, smoothly switch speaking turns with virtually no delay, provide their interlocutors with verbal and nonverbal backchannel feedback, wait for and react to such feedback, execute physical tasks in tight synchrony, etc. If virtual humans are to achieve such interpersonal coordination they require very flexible behavior plans that are adjustable on-the-fly. In this paper we discuss how such plans are represented, maintained and constructed in our BML realizer Elckerlyc. We argue that behavior scheduling for Virtual Humans can be viewed as a constraint satisfaction problem, and show how Elckerlyc uses this view in its flexible behavior plan representation that allows one to make on-the-fly adjustments to behaviors while keeping the specified constraints between them intact.
Original languageUndefined
Pages (from-to)305-327
Number of pages23
JournalAutonomous agents and multi-agent systems
Volume27
Issue number2
DOIs
Publication statusPublished - Sep 2013

Keywords

  • EWI-22871
  • IR-86108
  • METIS-297596
  • Virtual Humans · Behavior Markup Language · SAIBA · Multimodal plan representation · Interpersonal coordination

Cite this

@article{74b38af2b196459e807e51f01b70140c,
title = "Multimodal plan representation for adaptable BML scheduling",
abstract = "Natural human interaction is characterized by interpersonal coordination: interlocutors converge in their speech rates, smoothly switch speaking turns with virtually no delay, provide their interlocutors with verbal and nonverbal backchannel feedback, wait for and react to such feedback, execute physical tasks in tight synchrony, etc. If virtual humans are to achieve such interpersonal coordination they require very flexible behavior plans that are adjustable on-the-fly. In this paper we discuss how such plans are represented, maintained and constructed in our BML realizer Elckerlyc. We argue that behavior scheduling for Virtual Humans can be viewed as a constraint satisfaction problem, and show how Elckerlyc uses this view in its flexible behavior plan representation that allows one to make on-the-fly adjustments to behaviors while keeping the specified constraints between them intact.",
keywords = "EWI-22871, IR-86108, METIS-297596, Virtual Humans · Behavior Markup Language · SAIBA · Multimodal plan representation · Interpersonal coordination",
author = "{van Welbergen}, H. and Dennis Reidsma and Jakob Zwiers",
note = "eemcs-eprint-22871",
year = "2013",
month = "9",
doi = "10.1007/s10458-012-9217-6",
language = "Undefined",
volume = "27",
pages = "305--327",
journal = "Autonomous agents and multi-agent systems",
issn = "1387-2532",
publisher = "Springer",
number = "2",

}

Multimodal plan representation for adaptable BML scheduling. / van Welbergen, H.; Reidsma, Dennis; Zwiers, Jakob.

In: Autonomous agents and multi-agent systems, Vol. 27, No. 2, 09.2013, p. 305-327.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Multimodal plan representation for adaptable BML scheduling

AU - van Welbergen, H.

AU - Reidsma, Dennis

AU - Zwiers, Jakob

N1 - eemcs-eprint-22871

PY - 2013/9

Y1 - 2013/9

N2 - Natural human interaction is characterized by interpersonal coordination: interlocutors converge in their speech rates, smoothly switch speaking turns with virtually no delay, provide their interlocutors with verbal and nonverbal backchannel feedback, wait for and react to such feedback, execute physical tasks in tight synchrony, etc. If virtual humans are to achieve such interpersonal coordination they require very flexible behavior plans that are adjustable on-the-fly. In this paper we discuss how such plans are represented, maintained and constructed in our BML realizer Elckerlyc. We argue that behavior scheduling for Virtual Humans can be viewed as a constraint satisfaction problem, and show how Elckerlyc uses this view in its flexible behavior plan representation that allows one to make on-the-fly adjustments to behaviors while keeping the specified constraints between them intact.

AB - Natural human interaction is characterized by interpersonal coordination: interlocutors converge in their speech rates, smoothly switch speaking turns with virtually no delay, provide their interlocutors with verbal and nonverbal backchannel feedback, wait for and react to such feedback, execute physical tasks in tight synchrony, etc. If virtual humans are to achieve such interpersonal coordination they require very flexible behavior plans that are adjustable on-the-fly. In this paper we discuss how such plans are represented, maintained and constructed in our BML realizer Elckerlyc. We argue that behavior scheduling for Virtual Humans can be viewed as a constraint satisfaction problem, and show how Elckerlyc uses this view in its flexible behavior plan representation that allows one to make on-the-fly adjustments to behaviors while keeping the specified constraints between them intact.

KW - EWI-22871

KW - IR-86108

KW - METIS-297596

KW - Virtual Humans · Behavior Markup Language · SAIBA · Multimodal plan representation · Interpersonal coordination

U2 - 10.1007/s10458-012-9217-6

DO - 10.1007/s10458-012-9217-6

M3 - Article

VL - 27

SP - 305

EP - 327

JO - Autonomous agents and multi-agent systems

JF - Autonomous agents and multi-agent systems

SN - 1387-2532

IS - 2

ER -