Evaluating the Future of HCI: Challenges for the Evaluation of Emerging Applications

Ronald Walter Poppe, R.J. Rienks, Elisabeth M.A.G. van Dijk

  • 19 Citations

Abstract

Current evaluation methods are inappropriate for emerging HCI applications. In this paper, we give three examples of these applications and show that traditional evaluation methods fail. We identify trends in HCI development and discuss the issues that arise with evaluation. We aim at achieving increased awareness that evaluation too has to evolve in order to support the emerging trends in HCI systems.
Original languageEnglish
Title of host publicationArtificial Intelligence for Human Computing
Subtitle of host publicationICMI 2006 and IJCAI 2007 International Workshops, Banff, Canada, November 3, 2006, Hyderabad, India, January 6, 2007, Revised Seleced and Invited Papers
EditorsT.S Huang, Antinus Nijholt, Maja Pantic, A. Pentland
Place of PublicationBerlin
PublisherSpringer Verlag
Pages234-250
Number of pages17
ISBN (Print)978-3-540-72346-2
DOIs
StatePublished - 2007
Event8th International Conference on Multimodal Interfaces, ICMI 2006 - Banff, Canada

Publication series

NameLecture Notes in Artificial Intelligence
PublisherSpringer Verlag
Number4451
Volume4451

Conference

Conference8th International Conference on Multimodal Interfaces, ICMI 2006
Abbreviated titleICMI
CountryCanada
CityBanff
Period2/11/064/11/06

Fingerprint

Human computer interaction

Keywords

  • EC Grant Agreement nr.: FP6/506811
  • METIS-241735
  • IR-61774
  • EWI-10374

Cite this

Poppe, R. W., Rienks, R. J., & van Dijk, E. M. A. G. (2007). Evaluating the Future of HCI: Challenges for the Evaluation of Emerging Applications. In T. S. Huang, A. Nijholt, M. Pantic, & A. Pentland (Eds.), Artificial Intelligence for Human Computing: ICMI 2006 and IJCAI 2007 International Workshops, Banff, Canada, November 3, 2006, Hyderabad, India, January 6, 2007, Revised Seleced and Invited Papers (pp. 234-250). (Lecture Notes in Artificial Intelligence; Vol. 4451, No. 4451). Berlin: Springer Verlag. DOI: 10.1007/978-3-540-72348-6_12

Poppe, Ronald Walter; Rienks, R.J.; van Dijk, Elisabeth M.A.G. / Evaluating the Future of HCI : Challenges for the Evaluation of Emerging Applications.

Artificial Intelligence for Human Computing: ICMI 2006 and IJCAI 2007 International Workshops, Banff, Canada, November 3, 2006, Hyderabad, India, January 6, 2007, Revised Seleced and Invited Papers. ed. / T.S Huang; Antinus Nijholt; Maja Pantic; A. Pentland. Berlin : Springer Verlag, 2007. p. 234-250 (Lecture Notes in Artificial Intelligence; Vol. 4451, No. 4451).

Research output: Scientific - peer-reviewChapter

@inbook{ca1bd581cc5247b7993429376138069e,
title = "Evaluating the Future of HCI: Challenges for the Evaluation of Emerging Applications",
abstract = "Current evaluation methods are inappropriate for emerging HCI applications. In this paper, we give three examples of these applications and show that traditional evaluation methods fail. We identify trends in HCI development and discuss the issues that arise with evaluation. We aim at achieving increased awareness that evaluation too has to evolve in order to support the emerging trends in HCI systems.",
keywords = "EC Grant Agreement nr.: FP6/506811, METIS-241735, IR-61774, EWI-10374",
author = "Poppe, {Ronald Walter} and R.J. Rienks and {van Dijk}, {Elisabeth M.A.G.}",
year = "2007",
doi = "10.1007/978-3-540-72348-6_12",
isbn = "978-3-540-72346-2",
series = "Lecture Notes in Artificial Intelligence",
publisher = "Springer Verlag",
number = "4451",
pages = "234--250",
editor = "T.S Huang and Antinus Nijholt and Maja Pantic and A. Pentland",
booktitle = "Artificial Intelligence for Human Computing",

}

Poppe, RW, Rienks, RJ & van Dijk, EMAG 2007, Evaluating the Future of HCI: Challenges for the Evaluation of Emerging Applications. in TS Huang, A Nijholt, M Pantic & A Pentland (eds), Artificial Intelligence for Human Computing: ICMI 2006 and IJCAI 2007 International Workshops, Banff, Canada, November 3, 2006, Hyderabad, India, January 6, 2007, Revised Seleced and Invited Papers. Lecture Notes in Artificial Intelligence, no. 4451, vol. 4451, Springer Verlag, Berlin, pp. 234-250, 8th International Conference on Multimodal Interfaces, ICMI 2006, Banff, Canada, 2-4 November. DOI: 10.1007/978-3-540-72348-6_12

Evaluating the Future of HCI : Challenges for the Evaluation of Emerging Applications. / Poppe, Ronald Walter; Rienks, R.J.; van Dijk, Elisabeth M.A.G.

Artificial Intelligence for Human Computing: ICMI 2006 and IJCAI 2007 International Workshops, Banff, Canada, November 3, 2006, Hyderabad, India, January 6, 2007, Revised Seleced and Invited Papers. ed. / T.S Huang; Antinus Nijholt; Maja Pantic; A. Pentland. Berlin : Springer Verlag, 2007. p. 234-250 (Lecture Notes in Artificial Intelligence; Vol. 4451, No. 4451).

Research output: Scientific - peer-reviewChapter

TY - CHAP

T1 - Evaluating the Future of HCI

T2 - Challenges for the Evaluation of Emerging Applications

AU - Poppe,Ronald Walter

AU - Rienks,R.J.

AU - van Dijk,Elisabeth M.A.G.

PY - 2007

Y1 - 2007

N2 - Current evaluation methods are inappropriate for emerging HCI applications. In this paper, we give three examples of these applications and show that traditional evaluation methods fail. We identify trends in HCI development and discuss the issues that arise with evaluation. We aim at achieving increased awareness that evaluation too has to evolve in order to support the emerging trends in HCI systems.

AB - Current evaluation methods are inappropriate for emerging HCI applications. In this paper, we give three examples of these applications and show that traditional evaluation methods fail. We identify trends in HCI development and discuss the issues that arise with evaluation. We aim at achieving increased awareness that evaluation too has to evolve in order to support the emerging trends in HCI systems.

KW - EC Grant Agreement nr.: FP6/506811

KW - METIS-241735

KW - IR-61774

KW - EWI-10374

U2 - 10.1007/978-3-540-72348-6_12

DO - 10.1007/978-3-540-72348-6_12

M3 - Chapter

SN - 978-3-540-72346-2

T3 - Lecture Notes in Artificial Intelligence

SP - 234

EP - 250

BT - Artificial Intelligence for Human Computing

PB - Springer Verlag

ER -

Poppe RW, Rienks RJ, van Dijk EMAG. Evaluating the Future of HCI: Challenges for the Evaluation of Emerging Applications. In Huang TS, Nijholt A, Pantic M, Pentland A, editors, Artificial Intelligence for Human Computing: ICMI 2006 and IJCAI 2007 International Workshops, Banff, Canada, November 3, 2006, Hyderabad, India, January 6, 2007, Revised Seleced and Invited Papers. Berlin: Springer Verlag. 2007. p. 234-250. (Lecture Notes in Artificial Intelligence; 4451). Available from, DOI: 10.1007/978-3-540-72348-6_12