Reference resolution in multi-modal interaction: Preliminary observations

G.R. González González (Editor), Antinus Nijholt

    Research output: Contribution to conferencePaperAcademicpeer-review

    28 Downloads (Pure)

    Abstract

    In this paper we present our research on multimodal interaction in and with virtual environments. The aim of this presentation is to emphasize the necessity to spend more research on reference resolution in multimodal contexts. In multi-modal interaction the human conversational partner can apply more than one modality in conveying his or her message to the environment in which a computer detects and interprets signals from different modalities. We show some naturally arising problems but do not give general solutions. Rather we decide to perform more detailed research on reference resolution in uni-modal contexts to obtain methods generalizable to multi-modal contexts. Since we try to build applications for a Dutch audience and since hardly any research has been done on reference resolution for Dutch, we give results on the resolution of anaphoric and deictic references in Dutch texts. We hope to be able to extend these results to our multimodal contexts later.
    Original languageEnglish
    Pages127-144
    Number of pages18
    Publication statusPublished - 7 Jun 2002
    EventIII Conferencia Internacional 'Lengua, Comunicacion y Desarrollo' - Pinar del Rio, Cuba
    Duration: 7 Jun 200212 Jun 2002
    Conference number: 3

    Conference

    ConferenceIII Conferencia Internacional 'Lengua, Comunicacion y Desarrollo'
    CountryCuba
    CityPinar del Rio
    Period7/06/0212/06/02

    Keywords

    • EWI-6669
    • HMI-MI: MULTIMODAL INTERACTIONS
    • IR-66304
    • reference resolution
    • anaphora resolution
    • Multi-modal interaction
    • Virtual Reality

    Fingerprint Dive into the research topics of 'Reference resolution in multi-modal interaction: Preliminary observations'. Together they form a unique fingerprint.

    Cite this