Dialogues with a Talking Face for Web-based Services and Transactions

Joris Hulstijn, Anton Nijholt, Hendri Hondorp, Mathieu van den Berk, Arjan van Hessen

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    Abstract

    In this paper we discuss our research on interactions in a virtual theatre that has been built using VRML and therefore can be accessed through Web pages. In the virtual environment we employ several agents. The virtual theatre allows navigation input through keyboard and mouse, but there is also a navigation agent which listens to typed input and spoken commands. Feedback of the system is given using speech synthesis. We also have an information agent which allows a natural language dialogue with the system where the input is keyboard-driven and the output is both with tables as with template driven natural language generation. In development are several talking faces for the different agents in the virtual world. At this moment an avatar with a cartoon-like talking face driven by a text-to-speech synthesizer can provide users with information about performances in the theatre.
    Original languageEnglish
    Title of host publicationProceedings Face to Face workshop
    EditorsZ.M. Ruttkay
    Place of PublicationAmsterdam
    PublisherCentrum voor Wiskunde en Informatica
    Pages12-17
    Number of pages6
    Publication statusPublished - Mar 1999
    EventProceedings Face-to-Face Workshop 1999 - Centrum voor Wiskunde en Informatica, Amsterdam, Netherlands
    Duration: 19 Mar 199919 Mar 1999

    Workshop

    WorkshopProceedings Face-to-Face Workshop 1999
    Country/TerritoryNetherlands
    CityAmsterdam
    Period19/03/9919/03/99

    Keywords

    • HMI-MI: MULTIMODAL INTERACTIONS
    • EWI-9761
    • METIS-119611
    • Virtual Reality
    • Talking Faces
    • Text-to-Speech Synthesis
    • Agent technology
    • Speech recognition

    Fingerprint

    Dive into the research topics of 'Dialogues with a Talking Face for Web-based Services and Transactions'. Together they form a unique fingerprint.

    Cite this