Issues in multimodal nonverbal communication and emotion in embodied (conversational) agents

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    Abstract

    Virtual worlds are getting inhabited by virtual humans. Sometimes they act as (autonomous) embodied conversational agents; sometimes they represent human visitors and reflect (real-time) actions performed by the human visitors or users of the environment. It is not always necessary to represent a full body or any body at all. However, there are also many applications where it can be useful to have an embodied agents that does not only allow verbal interaction, but also interacts through nonverbal means, including a display of emotion. In this paper we survey the main modalities to show emotion in an embodied conversational agent. We argue that for many situations it is more important to have subtle ways of adding nonverbal cues to agent-human interaction than to be able to express some discrete full-blown emotions. We illustrate this with two of our research projects, one on gaze behavior of an embodied conversational agent and one on showing intensities and blends of emotions in facial expressions of an embodied agent.
    Original languageEnglish
    Title of host publicationThe 6th World Multiconference on Systemics, Cybernetics and Informatics
    Subtitle of host publicationJuly 14-18, 2002, Orlando, Florida, USA
    EditorsI.N. Callaos, A. Breda, Y. Fernandez
    Place of PublicationOrlando, FL, USA
    PublisherInternational Institute of Informatics and Systemics (IIIS)
    Pages208-214
    Number of pages7
    VolumeVolume II: Concepts and Applications of Systemics, Cybernetics and Informatics
    ISBN (Print)980-07-8150-1
    Publication statusPublished - 14 Jul 2002
    Event6th World Multi-Conference on Systematics, Cybernetics and Informatics (SCI 2002) and the 8th International Conference on Information Systems Analysis and Synthesis (ISAS 2002) - Orlando, United States
    Duration: 14 Jul 200218 Jul 2002

    Conference

    Conference6th World Multi-Conference on Systematics, Cybernetics and Informatics (SCI 2002) and the 8th International Conference on Information Systems Analysis and Synthesis (ISAS 2002)
    Abbreviated titleSCI-ISAS
    CountryUnited States
    CityOrlando
    Period14/07/0218/07/02

    Keywords

    • HMI-VRG: Virtual Reality and Graphics
    • Gaze behaviour
    • Emotion
    • Turn taking
    • Non-verbal communication
    • Embodied conversational agents
    • Virtual reality

    Fingerprint Dive into the research topics of 'Issues in multimodal nonverbal communication and emotion in embodied (conversational) agents'. Together they form a unique fingerprint.

  • Cite this

    Nijholt, A. (2002). Issues in multimodal nonverbal communication and emotion in embodied (conversational) agents. In I. N. Callaos, A. Breda, & Y. Fernandez (Eds.), The 6th World Multiconference on Systemics, Cybernetics and Informatics: July 14-18, 2002, Orlando, Florida, USA (Vol. Volume II: Concepts and Applications of Systemics, Cybernetics and Informatics, pp. 208-214). Orlando, FL, USA: International Institute of Informatics and Systemics (IIIS).