Affordances in conversational interactions with multimodal QA systems

Andreea Niculescu

doi:10.1007/978-3-540-89350-9_16

Affordances in conversational interactions with multimodal QA systems

Andreea Niculescu

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

1 Citation (Scopus)

202 Downloads (Pure)

Abstract

Implementation of adequate conversational structures is a key issue in developing successful interactive user interfaces. A way of testing the adequacy of the structures is to prove the correct orientation of each communicative action towards a preceding action. We refer to this orientation leading to a certain response as the affordance of the communicative action. In this paper we present a case study where affordances of implemented conversational structures (including verbal and graphical elements) in a multimodal medical QA system are identified applying Conversation Analysis (CA) tools and tested using the Cognitive Walkthrough (CW) method. The CW method was modified to fit the conversational approach and tested with five expert evaluators. Results showed that the affordance analysis helps detecting inefficient constructions leading to disruptions in the dialog flow, spots unnecessary functions and provides important insights on systems easy-of-use.

Original language	English
Title of host publication	HCI and Usability for Education and Work
Subtitle of host publication	4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, November 20-21, 2008. Proceedings
Editors	Andreas Holzinger
Place of Publication	Berlin, Heidelberg
Publisher	Springer
Pages	221-236
Number of pages	16
ISBN (Electronic)	978-3-540-89350-9
ISBN (Print)	978-3-540-89349-3
DOIs	https://doi.org/10.1007/978-3-540-89350-9_16
Publication status	Published - Nov 2008
Event	4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008 - Graz, Austria Duration: 20 Nov 2008 → 21 Nov 2008 Conference number: 4

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	5298
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008
Abbreviated title	USAB
Country	Austria
City	Graz
Period	20/11/08 → 21/11/08

Keywords

HMI-MI: MULTIMODAL INTERACTIONS
Conversational interactions
Multimodal QA systems
Affordances
Usability inspection
Cognitive walkthrough

Access to Document

10.1007/978-3-540-89350-9_16

Fingerprint Dive into the research topics of 'Affordances in conversational interactions with multimodal QA systems'. Together they form a unique fingerprint.

Cite this

Niculescu, A. (2008). Affordances in conversational interactions with multimodal QA systems. In A. Holzinger (Ed.), HCI and Usability for Education and Work: 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, November 20-21, 2008. Proceedings (pp. 221-236). (Lecture Notes in Computer Science; Vol. 5298). Springer. https://doi.org/10.1007/978-3-540-89350-9_16

Niculescu, Andreea. / Affordances in conversational interactions with multimodal QA systems. HCI and Usability for Education and Work: 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, November 20-21, 2008. Proceedings. editor / Andreas Holzinger. Berlin, Heidelberg : Springer, 2008. pp. 221-236 (Lecture Notes in Computer Science).

@inproceedings{a9a64b752cbb4539b14a8fc2095cd1bd,

title = "Affordances in conversational interactions with multimodal QA systems",

abstract = "Implementation of adequate conversational structures is a key issue in developing successful interactive user interfaces. A way of testing the adequacy of the structures is to prove the correct orientation of each communicative action towards a preceding action. We refer to this orientation leading to a certain response as the affordance of the communicative action. In this paper we present a case study where affordances of implemented conversational structures (including verbal and graphical elements) in a multimodal medical QA system are identified applying Conversation Analysis (CA) tools and tested using the Cognitive Walkthrough (CW) method. The CW method was modified to fit the conversational approach and tested with five expert evaluators. Results showed that the affordance analysis helps detecting inefficient constructions leading to disruptions in the dialog flow, spots unnecessary functions and provides important insights on systems easy-of-use.",

keywords = "HMI-MI: MULTIMODAL INTERACTIONS, Conversational interactions, Multimodal QA systems, Affordances, Usability inspection, Cognitive walkthrough",

author = "Andreea Niculescu",

year = "2008",

month = nov,

doi = "10.1007/978-3-540-89350-9_16",

language = "English",

isbn = "978-3-540-89349-3",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "221--236",

editor = "Andreas Holzinger",

booktitle = "HCI and Usability for Education and Work",

note = "4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, USAB ; Conference date: 20-11-2008 Through 21-11-2008",

}

Niculescu, A 2008, Affordances in conversational interactions with multimodal QA systems. in A Holzinger (ed.), HCI and Usability for Education and Work: 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, November 20-21, 2008. Proceedings. Lecture Notes in Computer Science, vol. 5298, Springer, Berlin, Heidelberg, pp. 221-236, 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, 20/11/08. https://doi.org/10.1007/978-3-540-89350-9_16

Affordances in conversational interactions with multimodal QA systems. / Niculescu, Andreea.

HCI and Usability for Education and Work: 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, November 20-21, 2008. Proceedings. ed. / Andreas Holzinger. Berlin, Heidelberg : Springer, 2008. p. 221-236 (Lecture Notes in Computer Science; Vol. 5298).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Affordances in conversational interactions with multimodal QA systems

AU - Niculescu, Andreea

N1 - Conference code: 4

PY - 2008/11

Y1 - 2008/11

N2 - Implementation of adequate conversational structures is a key issue in developing successful interactive user interfaces. A way of testing the adequacy of the structures is to prove the correct orientation of each communicative action towards a preceding action. We refer to this orientation leading to a certain response as the affordance of the communicative action. In this paper we present a case study where affordances of implemented conversational structures (including verbal and graphical elements) in a multimodal medical QA system are identified applying Conversation Analysis (CA) tools and tested using the Cognitive Walkthrough (CW) method. The CW method was modified to fit the conversational approach and tested with five expert evaluators. Results showed that the affordance analysis helps detecting inefficient constructions leading to disruptions in the dialog flow, spots unnecessary functions and provides important insights on systems easy-of-use.

AB - Implementation of adequate conversational structures is a key issue in developing successful interactive user interfaces. A way of testing the adequacy of the structures is to prove the correct orientation of each communicative action towards a preceding action. We refer to this orientation leading to a certain response as the affordance of the communicative action. In this paper we present a case study where affordances of implemented conversational structures (including verbal and graphical elements) in a multimodal medical QA system are identified applying Conversation Analysis (CA) tools and tested using the Cognitive Walkthrough (CW) method. The CW method was modified to fit the conversational approach and tested with five expert evaluators. Results showed that the affordance analysis helps detecting inefficient constructions leading to disruptions in the dialog flow, spots unnecessary functions and provides important insights on systems easy-of-use.

KW - HMI-MI: MULTIMODAL INTERACTIONS

KW - Conversational interactions

KW - Multimodal QA systems

KW - Affordances

KW - Usability inspection

KW - Cognitive walkthrough

U2 - 10.1007/978-3-540-89350-9_16

DO - 10.1007/978-3-540-89350-9_16

M3 - Conference contribution

SN - 978-3-540-89349-3

T3 - Lecture Notes in Computer Science

SP - 221

EP - 236

BT - HCI and Usability for Education and Work

A2 - Holzinger, Andreas

PB - Springer

CY - Berlin, Heidelberg

T2 - 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008

Y2 - 20 November 2008 through 21 November 2008

ER -

Niculescu A. Affordances in conversational interactions with multimodal QA systems. In Holzinger A, editor, HCI and Usability for Education and Work: 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, November 20-21, 2008. Proceedings. Berlin, Heidelberg: Springer. 2008. p. 221-236. (Lecture Notes in Computer Science). https://doi.org/10.1007/978-3-540-89350-9_16