Towards a Unified Knowledge-Based Approach to Modality Choice

Y.S. Bachvarova, Elisabeth M.A.G. van Dijk, Antinus Nijholt

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    17 Downloads (Pure)

    Abstract

    This paper advances a unified knowledge-based approach to the process of choosing the most appropriate modality or combination of modalities in multimodal output generation. We propose a Modality Ontology (MO) that models the knowledge needed to support the two most fundamental processes determining modality choice – modality allocation (choosing the modality or set of modalities that can best support a particular type of information) and modality combination (selecting an optimal final combination of modalities). In the proposed ontology we model the main levels which collectively determine the characteristics of each modality and the specific relationships between different modalities that are important for multi-modal meaning making. This ontology aims to support the automatic selection of modalities and combinations of modalities that are suitable to convey the meaning of the intended message.
    Original languageEnglish
    Title of host publicationMOG 2007
    Subtitle of host publicationWorkshop on Multimodal Output Generation: CTIT Proceedings
    EditorsIelka van der Sluis, Mariët Theune, Ehud Reiter, Emiel Krahmer
    Place of PublicationEnschede
    PublisherCentre for Telematics and Information Technology (CTIT)
    Pages5-15
    Number of pages11
    Publication statusPublished - 20 Jan 2007
    EventWorkshop on Multimodal Output Generation, MOG 2007 - University of Aberdeen, Aberdeen, Scotland, United Kingdom
    Duration: 25 Jan 200726 Jan 2007

    Publication series

    NameCTIT Workshop Proceedings Series
    PublisherCentre for Telematics and Information Technology University of Twente
    Number06472
    VolumeWP07-01
    ISSN (Print)1574-0846
    ISSN (Electronic)0929-0672

    Workshop

    WorkshopWorkshop on Multimodal Output Generation, MOG 2007
    Abbreviated titleMOG
    CountryUnited Kingdom
    CityAberdeen, Scotland
    Period25/01/0726/01/07

    Fingerprint

    Ontology

    Keywords

    • Modality ontology
    • Modality combination
    • Modality allocation
    • Modality choice
    • HMI-SLT: Speech and Language Technology

    Cite this

    Bachvarova, Y. S., van Dijk, E. M. A. G., & Nijholt, A. (2007). Towards a Unified Knowledge-Based Approach to Modality Choice. In I. van der Sluis, M. Theune, E. Reiter, & E. Krahmer (Eds.), MOG 2007: Workshop on Multimodal Output Generation: CTIT Proceedings (pp. 5-15). (CTIT Workshop Proceedings Series; Vol. WP07-01, No. 06472). Enschede: Centre for Telematics and Information Technology (CTIT).
    Bachvarova, Y.S. ; van Dijk, Elisabeth M.A.G. ; Nijholt, Antinus. / Towards a Unified Knowledge-Based Approach to Modality Choice. MOG 2007: Workshop on Multimodal Output Generation: CTIT Proceedings. editor / Ielka van der Sluis ; Mariët Theune ; Ehud Reiter ; Emiel Krahmer. Enschede : Centre for Telematics and Information Technology (CTIT), 2007. pp. 5-15 (CTIT Workshop Proceedings Series; 06472).
    @inproceedings{cbcbd6b2ca0e4ccebfb5dfa6a613f612,
    title = "Towards a Unified Knowledge-Based Approach to Modality Choice",
    abstract = "This paper advances a unified knowledge-based approach to the process of choosing the most appropriate modality or combination of modalities in multimodal output generation. We propose a Modality Ontology (MO) that models the knowledge needed to support the two most fundamental processes determining modality choice – modality allocation (choosing the modality or set of modalities that can best support a particular type of information) and modality combination (selecting an optimal final combination of modalities). In the proposed ontology we model the main levels which collectively determine the characteristics of each modality and the specific relationships between different modalities that are important for multi-modal meaning making. This ontology aims to support the automatic selection of modalities and combinations of modalities that are suitable to convey the meaning of the intended message.",
    keywords = "Modality ontology, Modality combination, Modality allocation, Modality choice, HMI-SLT: Speech and Language Technology",
    author = "Y.S. Bachvarova and {van Dijk}, {Elisabeth M.A.G.} and Antinus Nijholt",
    year = "2007",
    month = "1",
    day = "20",
    language = "English",
    series = "CTIT Workshop Proceedings Series",
    publisher = "Centre for Telematics and Information Technology (CTIT)",
    number = "06472",
    pages = "5--15",
    editor = "{van der Sluis}, Ielka and Mari{\"e}t Theune and Ehud Reiter and Emiel Krahmer",
    booktitle = "MOG 2007",
    address = "Netherlands",

    }

    Bachvarova, YS, van Dijk, EMAG & Nijholt, A 2007, Towards a Unified Knowledge-Based Approach to Modality Choice. in I van der Sluis, M Theune, E Reiter & E Krahmer (eds), MOG 2007: Workshop on Multimodal Output Generation: CTIT Proceedings. CTIT Workshop Proceedings Series, no. 06472, vol. WP07-01, Centre for Telematics and Information Technology (CTIT), Enschede, pp. 5-15, Workshop on Multimodal Output Generation, MOG 2007, Aberdeen, Scotland, United Kingdom, 25/01/07.

    Towards a Unified Knowledge-Based Approach to Modality Choice. / Bachvarova, Y.S.; van Dijk, Elisabeth M.A.G.; Nijholt, Antinus.

    MOG 2007: Workshop on Multimodal Output Generation: CTIT Proceedings. ed. / Ielka van der Sluis; Mariët Theune; Ehud Reiter; Emiel Krahmer. Enschede : Centre for Telematics and Information Technology (CTIT), 2007. p. 5-15 (CTIT Workshop Proceedings Series; Vol. WP07-01, No. 06472).

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    TY - GEN

    T1 - Towards a Unified Knowledge-Based Approach to Modality Choice

    AU - Bachvarova, Y.S.

    AU - van Dijk, Elisabeth M.A.G.

    AU - Nijholt, Antinus

    PY - 2007/1/20

    Y1 - 2007/1/20

    N2 - This paper advances a unified knowledge-based approach to the process of choosing the most appropriate modality or combination of modalities in multimodal output generation. We propose a Modality Ontology (MO) that models the knowledge needed to support the two most fundamental processes determining modality choice – modality allocation (choosing the modality or set of modalities that can best support a particular type of information) and modality combination (selecting an optimal final combination of modalities). In the proposed ontology we model the main levels which collectively determine the characteristics of each modality and the specific relationships between different modalities that are important for multi-modal meaning making. This ontology aims to support the automatic selection of modalities and combinations of modalities that are suitable to convey the meaning of the intended message.

    AB - This paper advances a unified knowledge-based approach to the process of choosing the most appropriate modality or combination of modalities in multimodal output generation. We propose a Modality Ontology (MO) that models the knowledge needed to support the two most fundamental processes determining modality choice – modality allocation (choosing the modality or set of modalities that can best support a particular type of information) and modality combination (selecting an optimal final combination of modalities). In the proposed ontology we model the main levels which collectively determine the characteristics of each modality and the specific relationships between different modalities that are important for multi-modal meaning making. This ontology aims to support the automatic selection of modalities and combinations of modalities that are suitable to convey the meaning of the intended message.

    KW - Modality ontology

    KW - Modality combination

    KW - Modality allocation

    KW - Modality choice

    KW - HMI-SLT: Speech and Language Technology

    M3 - Conference contribution

    T3 - CTIT Workshop Proceedings Series

    SP - 5

    EP - 15

    BT - MOG 2007

    A2 - van der Sluis, Ielka

    A2 - Theune, Mariët

    A2 - Reiter, Ehud

    A2 - Krahmer, Emiel

    PB - Centre for Telematics and Information Technology (CTIT)

    CY - Enschede

    ER -

    Bachvarova YS, van Dijk EMAG, Nijholt A. Towards a Unified Knowledge-Based Approach to Modality Choice. In van der Sluis I, Theune M, Reiter E, Krahmer E, editors, MOG 2007: Workshop on Multimodal Output Generation: CTIT Proceedings. Enschede: Centre for Telematics and Information Technology (CTIT). 2007. p. 5-15. (CTIT Workshop Proceedings Series; 06472).