Elckerlyc goes mobile - Enabling natural interaction in mobile user interfaces

Randy Klaassen, Jordi Hendrix, Dennis Reidsma, Hendrikus J.A. op den Akker, Elisabeth M.A.G. van Dijk, Harm op den Akker

Abstract

The fast growth of computational resources and speech technology available on mobile devices makes it possible to entertain users of these devices in having a natural dialogue with service systems. These systems are sometimes perceived as social agents and this can be supported by presenting them on the interface by means of an animated embodied conversational agent. To take the full advantage of the power of embodied conversational agents in service systems it is important to support real-time, online and responsive interaction with the system through the embodied conversational agent. The design of responsive animated conversational agents is a daunting task. Elckerlyc is a model-based platform for the speci﬿cation and animation of synchronised multi-modal responsive animated agents. This paper presents a new light-weight PictureEngine that allows to run this platform in mobile applications. We describe the integration of the PictureEngine in the user interface of two different coaching applications and discuss the ﬿ndings from user evaluations. We also conducted a study to evaluate an editing tool for the speci﬿cation of the agent’s communicative behaviour. Twenty one participants had to specify the behaviour of an embodied conversational agent using the PictureEngine. We may conclude that this new lightweight back-end engine for the Elckerlyc platform makes it easier to build embodied conversational interfaces for mobile devices.
Original languageUndefined
Pages (from-to)45-56
Number of pages12
JournalInternational journal on advances in telecommunications
Volume6
Issue number1 & 2
StatePublished - Jul 2013

Fingerprint

Mobile devices
Positive ions
Animation
User interfaces
Engines

Keywords

  • EWI-23573
  • IR-87373
  • METIS-299985

Cite this

Klaassen, Randy; Hendrix, Jordi; Reidsma, Dennis; op den Akker, Hendrikus J.A.; van Dijk, Elisabeth M.A.G.; op den Akker, Harm / Elckerlyc goes mobile - Enabling natural interaction in mobile user interfaces.

In: International journal on advances in telecommunications, Vol. 6, No. 1 & 2, 07.2013, p. 45-56.

Research output: Scientific - peer-reviewArticle

@article{b6da988ecb954a7c8667572d5a6d041f,
title = "Elckerlyc goes mobile - Enabling natural interaction in mobile user interfaces",
abstract = "The fast growth of computational resources and speech technology available on mobile devices makes it possible to entertain users of these devices in having a natural dialogue with service systems. These systems are sometimes perceived as social agents and this can be supported by presenting them on the interface by means of an animated embodied conversational agent. To take the full advantage of the power of embodied conversational agents in service systems it is important to support real-time, online and responsive interaction with the system through the embodied conversational agent. The design of responsive animated conversational agents is a daunting task. Elckerlyc is a model-based platform for the speci﬿cation and animation of synchronised multi-modal responsive animated agents. This paper presents a new light-weight PictureEngine that allows to run this platform in mobile applications. We describe the integration of the PictureEngine in the user interface of two different coaching applications and discuss the ﬿ndings from user evaluations. We also conducted a study to evaluate an editing tool for the speci﬿cation of the agent’s communicative behaviour. Twenty one participants had to specify the behaviour of an embodied conversational agent using the PictureEngine. We may conclude that this new lightweight back-end engine for the Elckerlyc platform makes it easier to build embodied conversational interfaces for mobile devices.",
keywords = "EWI-23573, IR-87373, METIS-299985",
author = "Randy Klaassen and Jordi Hendrix and Dennis Reidsma and {op den Akker}, {Hendrikus J.A.} and {van Dijk}, {Elisabeth M.A.G.} and {op den Akker}, Harm",
note = "eemcs-eprint-23573",
year = "2013",
month = "7",
volume = "6",
pages = "45--56",
journal = "International journal on advances in telecommunications",
issn = "1942-2601",
number = "1 & 2",

}

Elckerlyc goes mobile - Enabling natural interaction in mobile user interfaces. / Klaassen, Randy; Hendrix, Jordi; Reidsma, Dennis; op den Akker, Hendrikus J.A.; van Dijk, Elisabeth M.A.G.; op den Akker, Harm.

In: International journal on advances in telecommunications, Vol. 6, No. 1 & 2, 07.2013, p. 45-56.

Research output: Scientific - peer-reviewArticle

TY - JOUR

T1 - Elckerlyc goes mobile - Enabling natural interaction in mobile user interfaces

AU - Klaassen,Randy

AU - Hendrix,Jordi

AU - Reidsma,Dennis

AU - op den Akker,Hendrikus J.A.

AU - van Dijk,Elisabeth M.A.G.

AU - op den Akker,Harm

N1 - eemcs-eprint-23573

PY - 2013/7

Y1 - 2013/7

N2 - The fast growth of computational resources and speech technology available on mobile devices makes it possible to entertain users of these devices in having a natural dialogue with service systems. These systems are sometimes perceived as social agents and this can be supported by presenting them on the interface by means of an animated embodied conversational agent. To take the full advantage of the power of embodied conversational agents in service systems it is important to support real-time, online and responsive interaction with the system through the embodied conversational agent. The design of responsive animated conversational agents is a daunting task. Elckerlyc is a model-based platform for the speci﬿cation and animation of synchronised multi-modal responsive animated agents. This paper presents a new light-weight PictureEngine that allows to run this platform in mobile applications. We describe the integration of the PictureEngine in the user interface of two different coaching applications and discuss the ﬿ndings from user evaluations. We also conducted a study to evaluate an editing tool for the speci﬿cation of the agent’s communicative behaviour. Twenty one participants had to specify the behaviour of an embodied conversational agent using the PictureEngine. We may conclude that this new lightweight back-end engine for the Elckerlyc platform makes it easier to build embodied conversational interfaces for mobile devices.

AB - The fast growth of computational resources and speech technology available on mobile devices makes it possible to entertain users of these devices in having a natural dialogue with service systems. These systems are sometimes perceived as social agents and this can be supported by presenting them on the interface by means of an animated embodied conversational agent. To take the full advantage of the power of embodied conversational agents in service systems it is important to support real-time, online and responsive interaction with the system through the embodied conversational agent. The design of responsive animated conversational agents is a daunting task. Elckerlyc is a model-based platform for the speci﬿cation and animation of synchronised multi-modal responsive animated agents. This paper presents a new light-weight PictureEngine that allows to run this platform in mobile applications. We describe the integration of the PictureEngine in the user interface of two different coaching applications and discuss the ﬿ndings from user evaluations. We also conducted a study to evaluate an editing tool for the speci﬿cation of the agent’s communicative behaviour. Twenty one participants had to specify the behaviour of an embodied conversational agent using the PictureEngine. We may conclude that this new lightweight back-end engine for the Elckerlyc platform makes it easier to build embodied conversational interfaces for mobile devices.

KW - EWI-23573

KW - IR-87373

KW - METIS-299985

M3 - Article

VL - 6

SP - 45

EP - 56

JO - International journal on advances in telecommunications

T2 - International journal on advances in telecommunications

JF - International journal on advances in telecommunications

SN - 1942-2601

IS - 1 & 2

ER -