Natural interaction with a virtual guide in a virtual environment: A multimodal dialogue system

Dennis Hofs, Mariët Theune*, Rieks op den Akker

*Corresponding author for this work

    Research output: Contribution to journalArticleAcademicpeer-review

    7 Citations (Scopus)
    76 Downloads (Pure)

    Abstract

    This paper describes the Virtual Guide, a multimodal dialogue system represented by an embodied conversational agent that can help users to find their way in a virtual environment, while adapting its affective linguistic style to that of the user. We discuss the modular architecture of the system, and describe the entire loop from multimodal input analysis to multimodal output generation. We also describe how the Virtual Guide detects the level of politeness of the user’s utterances in real-time during the dialogue and aligns its own language to that of the user, using different politeness strategies. Finally we report on our first user tests, and discuss some potential extensions to improve the system.
    Original languageEnglish
    Pages (from-to)141-153
    Number of pages13
    JournalJournal on multimodal user interfaces
    Volume3
    Issue number1-2
    DOIs
    Publication statusPublished - Mar 2010

    Keywords

    • EC Grant Agreement nr.: FP7/231287
    • Conversational agent
    • Application
    • Social interaction
    • Politeness
    • Multimodal analysis and generation

    Fingerprint

    Dive into the research topics of 'Natural interaction with a virtual guide in a virtual environment: A multimodal dialogue system'. Together they form a unique fingerprint.

    Cite this