Affordances and Cognitive Walkthrough for Analyzing Human-Virtual Human Interaction

  • 4 Citations

Abstract

This study investigates how the psychological notion of affordance, known from human computer interface design, can be adopted for the analysis and design of communication of a user with a Virtual Human (VH), as a novel interface. We take as starting point the original notion of affordance, used to describe the function of objects for humans. Then, we dwell on the humancomputer interaction case when the object used by the human is (a piece of software in) the computer. In the next step, we look at human-human communication and identify actual and perceived affordances of the human body and mind. Then using the generic framework of affordances, we explain certain essential phenomena of human-human multimodal communication. Finally, we show how they carry over to the case of communicating with a 'designed human', that is an VH, whose human-like communication means may be augmented with ones reminiscent of the computer and fictive worlds. In the closing section we discuss and reformulate the method of cognitive walkthrough to make it applicable for evaluating the design of verbal and nonverbal interactive behaviour of VHs.
Original languageUndefined
Title of host publicationVerbal and Nonverbal Features of Human-Human and Human-Machine Interaction
EditorsA. Esposito, N. Bourbakis, N. Avouris, I. Hatzilygeroudis
Place of PublicationLondon
PublisherSpringer Verlag
Pages94-110
Number of pages17
ISBN (Print)9783540708711
DOIs
StatePublished - 2008

Publication series

NameLecture Notes in Computer Science
PublisherSpringer Verlag
NumberDTR08-9/5042
Volume5042

Fingerprint

Communication
Interfaces (computer)

Keywords

  • EWI-13125
  • IR-62401
  • METIS-251106
  • HMI-MI: MULTIMODAL INTERACTIONS

Cite this

Ruttkay, Z. M., & op den Akker, H. J. A. (2008). Affordances and Cognitive Walkthrough for Analyzing Human-Virtual Human Interaction. In A. Esposito, N. Bourbakis, N. Avouris, & I. Hatzilygeroudis (Eds.), Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction (pp. 94-110). [10.1007/978-3-540-70872-8_7] (Lecture Notes in Computer Science; Vol. 5042, No. DTR08-9/5042). London: Springer Verlag. DOI: 10.1007/978-3-540-70872-8_7

Ruttkay, Z.M.; op den Akker, Hendrikus J.A. / Affordances and Cognitive Walkthrough for Analyzing Human-Virtual Human Interaction.

Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction. ed. / A. Esposito; N. Bourbakis; N. Avouris; I. Hatzilygeroudis. London : Springer Verlag, 2008. p. 94-110 10.1007/978-3-540-70872-8_7 (Lecture Notes in Computer Science; Vol. 5042, No. DTR08-9/5042).

Research output: Scientific - peer-reviewChapter

@inbook{46673ae3d11c4f9cb11c4fc6f270e68b,
title = "Affordances and Cognitive Walkthrough for Analyzing Human-Virtual Human Interaction",
abstract = "This study investigates how the psychological notion of affordance, known from human computer interface design, can be adopted for the analysis and design of communication of a user with a Virtual Human (VH), as a novel interface. We take as starting point the original notion of affordance, used to describe the function of objects for humans. Then, we dwell on the humancomputer interaction case when the object used by the human is (a piece of software in) the computer. In the next step, we look at human-human communication and identify actual and perceived affordances of the human body and mind. Then using the generic framework of affordances, we explain certain essential phenomena of human-human multimodal communication. Finally, we show how they carry over to the case of communicating with a 'designed human', that is an VH, whose human-like communication means may be augmented with ones reminiscent of the computer and fictive worlds. In the closing section we discuss and reformulate the method of cognitive walkthrough to make it applicable for evaluating the design of verbal and nonverbal interactive behaviour of VHs.",
keywords = "EWI-13125, IR-62401, METIS-251106, HMI-MI: MULTIMODAL INTERACTIONS",
author = "Z.M. Ruttkay and {op den Akker}, {Hendrikus J.A.}",
year = "2008",
doi = "10.1007/978-3-540-70872-8_7",
isbn = "9783540708711",
series = "Lecture Notes in Computer Science",
publisher = "Springer Verlag",
number = "DTR08-9/5042",
pages = "94--110",
editor = "A. Esposito and N. Bourbakis and N. Avouris and I. Hatzilygeroudis",
booktitle = "Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction",

}

Ruttkay, ZM & op den Akker, HJA 2008, Affordances and Cognitive Walkthrough for Analyzing Human-Virtual Human Interaction. in A Esposito, N Bourbakis, N Avouris & I Hatzilygeroudis (eds), Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction., 10.1007/978-3-540-70872-8_7, Lecture Notes in Computer Science, no. DTR08-9/5042, vol. 5042, Springer Verlag, London, pp. 94-110. DOI: 10.1007/978-3-540-70872-8_7

Affordances and Cognitive Walkthrough for Analyzing Human-Virtual Human Interaction. / Ruttkay, Z.M.; op den Akker, Hendrikus J.A.

Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction. ed. / A. Esposito; N. Bourbakis; N. Avouris; I. Hatzilygeroudis. London : Springer Verlag, 2008. p. 94-110 10.1007/978-3-540-70872-8_7 (Lecture Notes in Computer Science; Vol. 5042, No. DTR08-9/5042).

Research output: Scientific - peer-reviewChapter

TY - CHAP

T1 - Affordances and Cognitive Walkthrough for Analyzing Human-Virtual Human Interaction

AU - Ruttkay,Z.M.

AU - op den Akker,Hendrikus J.A.

PY - 2008

Y1 - 2008

N2 - This study investigates how the psychological notion of affordance, known from human computer interface design, can be adopted for the analysis and design of communication of a user with a Virtual Human (VH), as a novel interface. We take as starting point the original notion of affordance, used to describe the function of objects for humans. Then, we dwell on the humancomputer interaction case when the object used by the human is (a piece of software in) the computer. In the next step, we look at human-human communication and identify actual and perceived affordances of the human body and mind. Then using the generic framework of affordances, we explain certain essential phenomena of human-human multimodal communication. Finally, we show how they carry over to the case of communicating with a 'designed human', that is an VH, whose human-like communication means may be augmented with ones reminiscent of the computer and fictive worlds. In the closing section we discuss and reformulate the method of cognitive walkthrough to make it applicable for evaluating the design of verbal and nonverbal interactive behaviour of VHs.

AB - This study investigates how the psychological notion of affordance, known from human computer interface design, can be adopted for the analysis and design of communication of a user with a Virtual Human (VH), as a novel interface. We take as starting point the original notion of affordance, used to describe the function of objects for humans. Then, we dwell on the humancomputer interaction case when the object used by the human is (a piece of software in) the computer. In the next step, we look at human-human communication and identify actual and perceived affordances of the human body and mind. Then using the generic framework of affordances, we explain certain essential phenomena of human-human multimodal communication. Finally, we show how they carry over to the case of communicating with a 'designed human', that is an VH, whose human-like communication means may be augmented with ones reminiscent of the computer and fictive worlds. In the closing section we discuss and reformulate the method of cognitive walkthrough to make it applicable for evaluating the design of verbal and nonverbal interactive behaviour of VHs.

KW - EWI-13125

KW - IR-62401

KW - METIS-251106

KW - HMI-MI: MULTIMODAL INTERACTIONS

U2 - 10.1007/978-3-540-70872-8_7

DO - 10.1007/978-3-540-70872-8_7

M3 - Chapter

SN - 9783540708711

T3 - Lecture Notes in Computer Science

SP - 94

EP - 110

BT - Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction

PB - Springer Verlag

ER -

Ruttkay ZM, op den Akker HJA. Affordances and Cognitive Walkthrough for Analyzing Human-Virtual Human Interaction. In Esposito A, Bourbakis N, Avouris N, Hatzilygeroudis I, editors, Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction. London: Springer Verlag. 2008. p. 94-110. 10.1007/978-3-540-70872-8_7. (Lecture Notes in Computer Science; DTR08-9/5042). Available from, DOI: 10.1007/978-3-540-70872-8_7