How much control is enough? Influence of unreliable input on user experience

B.L.A. van de Laar, D. Plass - Oude Bos, B. Reuderink, Mannes Poel, Antinus Nijholt

  • 11 Citations

Abstract

Brain–computer interfaces (BCI) provide a valuable new input modality within human–computer interaction systems. However, like other body-based inputs such as gesture or gaze based systems, the system recognition of input commands is still far from perfect. This raises important questions, such as what level of control should such an interface be able to provide. What is the relationship between actual and perceived control? And in the case of applications for entertainment in which fun is an important part of user experience, should we even aim for the highest level of control, or is the optimum elsewhere? In this paper, we evaluate whether we can modulate the amount of control and if a game can be fun with less than perfect control. In the experiment users (n = 158) played a simple game in which a hamster has to be guided to the exit of a maze. The amount of control the user has over the hamster is varied. The variation of control through confusion matrices makes it possible to simulate the experience of using a BCI, while using the traditional keyboard for input. After each session the user completed a short questionnaire on user experience and perceived control. Analysis of the data showed that the perceived control of the user could largely be explained by the amount of control in the respective session. As expected, user frustration decreases with increasing control. Moreover, the results indicate that the relation between fun and control is not linear. Although at lower levels of control fun does increase with improved control, the level of fun drops just before perfect control is reached (with an optimum around 96%). This poses new insights for developers of games who want to incorporate some form of BCI or other modality with unreliable input in their game: for creating a fun game, unreliable input can be used to create a challenge for the user.
Original languageUndefined
Pages (from-to)1584-1592
Number of pages9
JournalIEEE transactions on cybernetics
Volume43
Issue number6
DOIs
StatePublished - 1 Dec 2013

Fingerprint

Brain computer interface
Human computer interaction
Experiments

Keywords

  • EWI-23625
  • HMI-HF: Human Factors
  • HMI-MI: MULTIMODAL INTERACTIONS
  • IR-89542
  • Brain-Computer Interfaces
  • Human computer interaction
  • METIS-302533
  • computer interfaces

Cite this

van de Laar, B.L.A.; Plass - Oude Bos, D.; Reuderink, B.; Poel, Mannes; Nijholt, Antinus / How much control is enough? Influence of unreliable input on user experience.

In: IEEE transactions on cybernetics, Vol. 43, No. 6, 01.12.2013, p. 1584-1592.

Research output: Scientific - peer-reviewArticle

@article{7f4b85c00ab14027a3382e093e3f2533,
title = "How much control is enough? Influence of unreliable input on user experience",
abstract = "Brain–computer interfaces (BCI) provide a valuable new input modality within human–computer interaction systems. However, like other body-based inputs such as gesture or gaze based systems, the system recognition of input commands is still far from perfect. This raises important questions, such as what level of control should such an interface be able to provide. What is the relationship between actual and perceived control? And in the case of applications for entertainment in which fun is an important part of user experience, should we even aim for the highest level of control, or is the optimum elsewhere? In this paper, we evaluate whether we can modulate the amount of control and if a game can be fun with less than perfect control. In the experiment users (n = 158) played a simple game in which a hamster has to be guided to the exit of a maze. The amount of control the user has over the hamster is varied. The variation of control through confusion matrices makes it possible to simulate the experience of using a BCI, while using the traditional keyboard for input. After each session the user completed a short questionnaire on user experience and perceived control. Analysis of the data showed that the perceived control of the user could largely be explained by the amount of control in the respective session. As expected, user frustration decreases with increasing control. Moreover, the results indicate that the relation between fun and control is not linear. Although at lower levels of control fun does increase with improved control, the level of fun drops just before perfect control is reached (with an optimum around 96%). This poses new insights for developers of games who want to incorporate some form of BCI or other modality with unreliable input in their game: for creating a fun game, unreliable input can be used to create a challenge for the user.",
keywords = "EWI-23625, HMI-HF: Human Factors, HMI-MI: MULTIMODAL INTERACTIONS, IR-89542, Brain-Computer Interfaces, Human computer interaction, METIS-302533, computer interfaces",
author = "{van de Laar}, B.L.A. and {Plass - Oude Bos}, D. and B. Reuderink and Mannes Poel and Antinus Nijholt",
note = "eemcs-eprint-23625",
year = "2013",
month = "12",
doi = "10.1109/TCYB.2013.2282279",
volume = "43",
pages = "1584--1592",
journal = "IEEE transactions on cybernetics",
issn = "2168-2267",
publisher = "IEEE Advancing Technology for Humanity",
number = "6",

}

How much control is enough? Influence of unreliable input on user experience. / van de Laar, B.L.A.; Plass - Oude Bos, D.; Reuderink, B.; Poel, Mannes; Nijholt, Antinus.

In: IEEE transactions on cybernetics, Vol. 43, No. 6, 01.12.2013, p. 1584-1592.

Research output: Scientific - peer-reviewArticle

TY - JOUR

T1 - How much control is enough? Influence of unreliable input on user experience

AU - van de Laar,B.L.A.

AU - Plass - Oude Bos,D.

AU - Reuderink,B.

AU - Poel,Mannes

AU - Nijholt,Antinus

N1 - eemcs-eprint-23625

PY - 2013/12/1

Y1 - 2013/12/1

N2 - Brain–computer interfaces (BCI) provide a valuable new input modality within human–computer interaction systems. However, like other body-based inputs such as gesture or gaze based systems, the system recognition of input commands is still far from perfect. This raises important questions, such as what level of control should such an interface be able to provide. What is the relationship between actual and perceived control? And in the case of applications for entertainment in which fun is an important part of user experience, should we even aim for the highest level of control, or is the optimum elsewhere? In this paper, we evaluate whether we can modulate the amount of control and if a game can be fun with less than perfect control. In the experiment users (n = 158) played a simple game in which a hamster has to be guided to the exit of a maze. The amount of control the user has over the hamster is varied. The variation of control through confusion matrices makes it possible to simulate the experience of using a BCI, while using the traditional keyboard for input. After each session the user completed a short questionnaire on user experience and perceived control. Analysis of the data showed that the perceived control of the user could largely be explained by the amount of control in the respective session. As expected, user frustration decreases with increasing control. Moreover, the results indicate that the relation between fun and control is not linear. Although at lower levels of control fun does increase with improved control, the level of fun drops just before perfect control is reached (with an optimum around 96%). This poses new insights for developers of games who want to incorporate some form of BCI or other modality with unreliable input in their game: for creating a fun game, unreliable input can be used to create a challenge for the user.

AB - Brain–computer interfaces (BCI) provide a valuable new input modality within human–computer interaction systems. However, like other body-based inputs such as gesture or gaze based systems, the system recognition of input commands is still far from perfect. This raises important questions, such as what level of control should such an interface be able to provide. What is the relationship between actual and perceived control? And in the case of applications for entertainment in which fun is an important part of user experience, should we even aim for the highest level of control, or is the optimum elsewhere? In this paper, we evaluate whether we can modulate the amount of control and if a game can be fun with less than perfect control. In the experiment users (n = 158) played a simple game in which a hamster has to be guided to the exit of a maze. The amount of control the user has over the hamster is varied. The variation of control through confusion matrices makes it possible to simulate the experience of using a BCI, while using the traditional keyboard for input. After each session the user completed a short questionnaire on user experience and perceived control. Analysis of the data showed that the perceived control of the user could largely be explained by the amount of control in the respective session. As expected, user frustration decreases with increasing control. Moreover, the results indicate that the relation between fun and control is not linear. Although at lower levels of control fun does increase with improved control, the level of fun drops just before perfect control is reached (with an optimum around 96%). This poses new insights for developers of games who want to incorporate some form of BCI or other modality with unreliable input in their game: for creating a fun game, unreliable input can be used to create a challenge for the user.

KW - EWI-23625

KW - HMI-HF: Human Factors

KW - HMI-MI: MULTIMODAL INTERACTIONS

KW - IR-89542

KW - Brain-Computer Interfaces

KW - Human computer interaction

KW - METIS-302533

KW - computer interfaces

U2 - 10.1109/TCYB.2013.2282279

DO - 10.1109/TCYB.2013.2282279

M3 - Article

VL - 43

SP - 1584

EP - 1592

JO - IEEE transactions on cybernetics

T2 - IEEE transactions on cybernetics

JF - IEEE transactions on cybernetics

SN - 2168-2267

IS - 6

ER -

van de Laar BLA, Plass - Oude Bos D, Reuderink B, Poel M, Nijholt A. How much control is enough? Influence of unreliable input on user experience. IEEE transactions on cybernetics. 2013 Dec 1;43(6):1584-1592. Available from, DOI: 10.1109/TCYB.2013.2282279