Affordances in conversational interactions with multimodal QA systems

Andreea Niculescu

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    1 Citation (Scopus)
    202 Downloads (Pure)

    Abstract

    Implementation of adequate conversational structures is a key issue in developing successful interactive user interfaces. A way of testing the adequacy of the structures is to prove the correct orientation of each communicative action towards a preceding action. We refer to this orientation leading to a certain response as the affordance of the communicative action. In this paper we present a case study where affordances of implemented conversational structures (including verbal and graphical elements) in a multimodal medical QA system are identified applying Conversation Analysis (CA) tools and tested using the Cognitive Walkthrough (CW) method. The CW method was modified to fit the conversational approach and tested with five expert evaluators. Results showed that the affordance analysis helps detecting inefficient constructions leading to disruptions in the dialog flow, spots unnecessary functions and provides important insights on systems easy-of-use.
    Original languageEnglish
    Title of host publicationHCI and Usability for Education and Work
    Subtitle of host publication4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, November 20-21, 2008. Proceedings
    EditorsAndreas Holzinger
    Place of PublicationBerlin, Heidelberg
    PublisherSpringer
    Pages221-236
    Number of pages16
    ISBN (Electronic)978-3-540-89350-9
    ISBN (Print)978-3-540-89349-3
    DOIs
    Publication statusPublished - Nov 2008
    Event4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008 - Graz, Austria
    Duration: 20 Nov 200821 Nov 2008
    Conference number: 4

    Publication series

    NameLecture Notes in Computer Science
    PublisherSpringer
    Volume5298
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008
    Abbreviated titleUSAB
    CountryAustria
    CityGraz
    Period20/11/0821/11/08

    Keywords

    • HMI-MI: MULTIMODAL INTERACTIONS
    • Conversational interactions
    • Multimodal QA systems
    • Affordances
    • Usability inspection
    • Cognitive walkthrough

    Fingerprint Dive into the research topics of 'Affordances in conversational interactions with multimodal QA systems'. Together they form a unique fingerprint.

    Cite this