Affordances in conversational interactions with multimodal QA systems

Andreea Niculescu

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

1 Citation (Scopus)
163 Downloads (Pure)

Abstract

Implementation of adequate conversational structures is a key issue in developing successful interactive user interfaces. A way of testing the adequacy of the structures is to prove the correct orientation of each communicative action towards a preceding action. We refer to this orientation leading to a certain response as the affordance of the communicative action. In this paper we present a case study where affordances of implemented conversational structures (including verbal and graphical elements) in a multimodal medical QA system are identified applying Conversation Analysis (CA) tools and tested using the Cognitive Walkthrough (CW) method. The CW method was modified to fit the conversational approach and tested with five expert evaluators. Results showed that the affordance analysis helps detecting inefficient constructions leading to disruptions in the dialog flow, spots unnecessary functions and provides important insights on systems easy-of-use.
Original languageEnglish
Title of host publicationHCI and Usability for Education and Work
Subtitle of host publication4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, November 20-21, 2008. Proceedings
EditorsAndreas Holzinger
Place of PublicationBerlin, Heidelberg
PublisherSpringer
Pages221-236
Number of pages16
ISBN (Electronic)978-3-540-89350-9
ISBN (Print)978-3-540-89349-3
DOIs
Publication statusPublished - Nov 2008
Event4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008 - Graz, Austria
Duration: 20 Nov 200821 Nov 2008
Conference number: 4

Publication series

NameLecture Notes in Computer Science
PublisherSpringer
Volume5298
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008
Abbreviated titleUSAB
CountryAustria
CityGraz
Period20/11/0821/11/08

Fingerprint

User interfaces
Testing

Keywords

  • HMI-MI: MULTIMODAL INTERACTIONS
  • Conversational interactions
  • Multimodal QA systems
  • Affordances
  • Usability inspection
  • Cognitive walkthrough

Cite this

Niculescu, A. (2008). Affordances in conversational interactions with multimodal QA systems. In A. Holzinger (Ed.), HCI and Usability for Education and Work: 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, November 20-21, 2008. Proceedings (pp. 221-236). (Lecture Notes in Computer Science; Vol. 5298). Berlin, Heidelberg: Springer. https://doi.org/10.1007/978-3-540-89350-9_16
Niculescu, Andreea. / Affordances in conversational interactions with multimodal QA systems. HCI and Usability for Education and Work: 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, November 20-21, 2008. Proceedings. editor / Andreas Holzinger. Berlin, Heidelberg : Springer, 2008. pp. 221-236 (Lecture Notes in Computer Science).
@inproceedings{a9a64b752cbb4539b14a8fc2095cd1bd,
title = "Affordances in conversational interactions with multimodal QA systems",
abstract = "Implementation of adequate conversational structures is a key issue in developing successful interactive user interfaces. A way of testing the adequacy of the structures is to prove the correct orientation of each communicative action towards a preceding action. We refer to this orientation leading to a certain response as the affordance of the communicative action. In this paper we present a case study where affordances of implemented conversational structures (including verbal and graphical elements) in a multimodal medical QA system are identified applying Conversation Analysis (CA) tools and tested using the Cognitive Walkthrough (CW) method. The CW method was modified to fit the conversational approach and tested with five expert evaluators. Results showed that the affordance analysis helps detecting inefficient constructions leading to disruptions in the dialog flow, spots unnecessary functions and provides important insights on systems easy-of-use.",
keywords = "HMI-MI: MULTIMODAL INTERACTIONS, Conversational interactions, Multimodal QA systems, Affordances, Usability inspection, Cognitive walkthrough",
author = "Andreea Niculescu",
year = "2008",
month = "11",
doi = "10.1007/978-3-540-89350-9_16",
language = "English",
isbn = "978-3-540-89349-3",
series = "Lecture Notes in Computer Science",
publisher = "Springer",
pages = "221--236",
editor = "Andreas Holzinger",
booktitle = "HCI and Usability for Education and Work",

}

Niculescu, A 2008, Affordances in conversational interactions with multimodal QA systems. in A Holzinger (ed.), HCI and Usability for Education and Work: 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, November 20-21, 2008. Proceedings. Lecture Notes in Computer Science, vol. 5298, Springer, Berlin, Heidelberg, pp. 221-236, 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, 20/11/08. https://doi.org/10.1007/978-3-540-89350-9_16

Affordances in conversational interactions with multimodal QA systems. / Niculescu, Andreea.

HCI and Usability for Education and Work: 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, November 20-21, 2008. Proceedings. ed. / Andreas Holzinger. Berlin, Heidelberg : Springer, 2008. p. 221-236 (Lecture Notes in Computer Science; Vol. 5298).

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - Affordances in conversational interactions with multimodal QA systems

AU - Niculescu, Andreea

PY - 2008/11

Y1 - 2008/11

N2 - Implementation of adequate conversational structures is a key issue in developing successful interactive user interfaces. A way of testing the adequacy of the structures is to prove the correct orientation of each communicative action towards a preceding action. We refer to this orientation leading to a certain response as the affordance of the communicative action. In this paper we present a case study where affordances of implemented conversational structures (including verbal and graphical elements) in a multimodal medical QA system are identified applying Conversation Analysis (CA) tools and tested using the Cognitive Walkthrough (CW) method. The CW method was modified to fit the conversational approach and tested with five expert evaluators. Results showed that the affordance analysis helps detecting inefficient constructions leading to disruptions in the dialog flow, spots unnecessary functions and provides important insights on systems easy-of-use.

AB - Implementation of adequate conversational structures is a key issue in developing successful interactive user interfaces. A way of testing the adequacy of the structures is to prove the correct orientation of each communicative action towards a preceding action. We refer to this orientation leading to a certain response as the affordance of the communicative action. In this paper we present a case study where affordances of implemented conversational structures (including verbal and graphical elements) in a multimodal medical QA system are identified applying Conversation Analysis (CA) tools and tested using the Cognitive Walkthrough (CW) method. The CW method was modified to fit the conversational approach and tested with five expert evaluators. Results showed that the affordance analysis helps detecting inefficient constructions leading to disruptions in the dialog flow, spots unnecessary functions and provides important insights on systems easy-of-use.

KW - HMI-MI: MULTIMODAL INTERACTIONS

KW - Conversational interactions

KW - Multimodal QA systems

KW - Affordances

KW - Usability inspection

KW - Cognitive walkthrough

U2 - 10.1007/978-3-540-89350-9_16

DO - 10.1007/978-3-540-89350-9_16

M3 - Conference contribution

SN - 978-3-540-89349-3

T3 - Lecture Notes in Computer Science

SP - 221

EP - 236

BT - HCI and Usability for Education and Work

A2 - Holzinger, Andreas

PB - Springer

CY - Berlin, Heidelberg

ER -

Niculescu A. Affordances in conversational interactions with multimodal QA systems. In Holzinger A, editor, HCI and Usability for Education and Work: 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, November 20-21, 2008. Proceedings. Berlin, Heidelberg: Springer. 2008. p. 221-236. (Lecture Notes in Computer Science). https://doi.org/10.1007/978-3-540-89350-9_16