A generic architecture and dialogue model for multimodal interaction

Abstract

This paper presents a generic architecture and a dialogue model for multimodal interaction. Architecture and model are transparent and have been used for different task domains. In this paper the emphasis is on their use for the navigation task in a virtual environment. The dialogue model is based on the information state approach and the recognition of dialogue acts. We explain how pairs of backward and forward looking tags and the preference rules of the dialogue act determiner together determine the structure of the dialogues that can be handled by the system. The system action selection mechanism and the problem of reference resolution are discussed in detail.
Original languageUndefined
Title of host publicationProceedings of the 1st Nordic Symposium on Multimodal Communication
EditorsP. Paggio, K. Jokinen, A. Jönsson
Place of PublicationCopenhagen
PublisherCST Publication, Center for Sprokteknologi
Pages79-91
Number of pages13
StatePublished - Sep 2003

Publication series

Name
PublisherCST Publication, Center for Sprogteknologi
Volume1
ISSN (Print)1600-339X

Fingerprint

Virtual reality
Navigation

Keywords

  • IR-66310
  • METIS-217378
  • EWI-6698

Cite this

Hofs, D. H. W., op den Akker, H. J. A., & Nijholt, A. (2003). A generic architecture and dialogue model for multimodal interaction. In P. Paggio, K. Jokinen, & A. Jönsson (Eds.), Proceedings of the 1st Nordic Symposium on Multimodal Communication (pp. 79-91). Copenhagen: CST Publication, Center for Sprokteknologi.

Hofs, D.H.W.; op den Akker, Hendrikus J.A.; Nijholt, Antinus / A generic architecture and dialogue model for multimodal interaction.

Proceedings of the 1st Nordic Symposium on Multimodal Communication. ed. / P. Paggio; K. Jokinen; A. Jönsson. Copenhagen : CST Publication, Center for Sprokteknologi, 2003. p. 79-91.

Research output: Scientific - peer-reviewConference contribution

@inbook{b8f0a4dd96f244ffa9ea316abe279c81,
title = "A generic architecture and dialogue model for multimodal interaction",
abstract = "This paper presents a generic architecture and a dialogue model for multimodal interaction. Architecture and model are transparent and have been used for different task domains. In this paper the emphasis is on their use for the navigation task in a virtual environment. The dialogue model is based on the information state approach and the recognition of dialogue acts. We explain how pairs of backward and forward looking tags and the preference rules of the dialogue act determiner together determine the structure of the dialogues that can be handled by the system. The system action selection mechanism and the problem of reference resolution are discussed in detail.",
keywords = "IR-66310, METIS-217378, EWI-6698",
author = "D.H.W. Hofs and {op den Akker}, {Hendrikus J.A.} and Antinus Nijholt",
note = "Imported from HMI",
year = "2003",
month = "9",
publisher = "CST Publication, Center for Sprokteknologi",
pages = "79--91",
editor = "P. Paggio and K. Jokinen and A. Jönsson",
booktitle = "Proceedings of the 1st Nordic Symposium on Multimodal Communication",

}

Hofs, DHW, op den Akker, HJA & Nijholt, A 2003, A generic architecture and dialogue model for multimodal interaction. in P Paggio, K Jokinen & A Jönsson (eds), Proceedings of the 1st Nordic Symposium on Multimodal Communication. CST Publication, Center for Sprokteknologi, Copenhagen, pp. 79-91.

A generic architecture and dialogue model for multimodal interaction. / Hofs, D.H.W.; op den Akker, Hendrikus J.A.; Nijholt, Antinus.

Proceedings of the 1st Nordic Symposium on Multimodal Communication. ed. / P. Paggio; K. Jokinen; A. Jönsson. Copenhagen : CST Publication, Center for Sprokteknologi, 2003. p. 79-91.

Research output: Scientific - peer-reviewConference contribution

TY - CHAP

T1 - A generic architecture and dialogue model for multimodal interaction

AU - Hofs,D.H.W.

AU - op den Akker,Hendrikus J.A.

AU - Nijholt,Antinus

N1 - Imported from HMI

PY - 2003/9

Y1 - 2003/9

N2 - This paper presents a generic architecture and a dialogue model for multimodal interaction. Architecture and model are transparent and have been used for different task domains. In this paper the emphasis is on their use for the navigation task in a virtual environment. The dialogue model is based on the information state approach and the recognition of dialogue acts. We explain how pairs of backward and forward looking tags and the preference rules of the dialogue act determiner together determine the structure of the dialogues that can be handled by the system. The system action selection mechanism and the problem of reference resolution are discussed in detail.

AB - This paper presents a generic architecture and a dialogue model for multimodal interaction. Architecture and model are transparent and have been used for different task domains. In this paper the emphasis is on their use for the navigation task in a virtual environment. The dialogue model is based on the information state approach and the recognition of dialogue acts. We explain how pairs of backward and forward looking tags and the preference rules of the dialogue act determiner together determine the structure of the dialogues that can be handled by the system. The system action selection mechanism and the problem of reference resolution are discussed in detail.

KW - IR-66310

KW - METIS-217378

KW - EWI-6698

M3 - Conference contribution

SP - 79

EP - 91

BT - Proceedings of the 1st Nordic Symposium on Multimodal Communication

PB - CST Publication, Center for Sprokteknologi

ER -

Hofs DHW, op den Akker HJA, Nijholt A. A generic architecture and dialogue model for multimodal interaction. In Paggio P, Jokinen K, Jönsson A, editors, Proceedings of the 1st Nordic Symposium on Multimodal Communication. Copenhagen: CST Publication, Center for Sprokteknologi. 2003. p. 79-91.