Speech and language interaction in a (virtual) cultural theatre

In this paper we survey research on interaction modalities in a theatre information and booking system. The original system, developed in the context of the Parlevink Research project, allowed natural language interaction using the keyboard. However, current research has made it possible to allow other modalities. Rather than presenting questions and answers on the screen, current research allows output using speech synthesis in combination with screen-based information. Moreover, since the system has been embedded in a virtual reality environment, which models a theatre, it has become interesting to investigate possible interactions between users and theatre agents. Presently we distinguish between an information and transaction agent which provides the user with information about performances and a navigation agent which helps the user to navigate in the virtual world. Possible interactions between these agents have not yet been investigated.