Avoiding split attention in computer-based testing: is neglecting additional information facilitative?

Halszka Jarodzka, Noortje Janssen, Paul A. Kirschner, Gijsbert Erkens

Research output: Contribution to journalArticleAcademicpeer-review

11 Citations (Scopus)

Abstract

This study investigated whether design guidelines for computer-based learning can be applied to computer-based testing (CBT). Twenty-two students completed a CBT exam with half of the questions presented in a split-screen format that was analogous to the original paper-and-pencil version and half in an integrated format. Results show that students attended to all information in the integrated format while ignoring information in the split format. Interestingly, and contrary to expectations, they worked more efficiently in the split format. A content analysis of the ignored information revealed that it was mostly not relevant to answering the questions, unnecessarily taxed students’ cognitive capacity and inefficiently increased the mental effort they expended. Further comparisons of different mental effort measures indicate that mental effort had an explicit (ie, self-reports, explicit utterances) and an implicit component (ie, silent pauses in thinking-aloud, eye tracking parameters). Consequently, when designing CBT environments, not only the design of the tasks but also the content of the given information and their effect on the different aspects of mental effort must be considered.
Original languageEnglish
Pages (from-to)803-817
Number of pages15
JournalBritish journal of educational technology
Volume46
Issue number4
DOIs
Publication statusPublished - 3 Jun 2015

Fingerprint

student
content analysis
learning

Keywords

  • METIS-309456
  • IR-94621

Cite this

Jarodzka, Halszka ; Janssen, Noortje ; Kirschner, Paul A. ; Erkens, Gijsbert. / Avoiding split attention in computer-based testing: is neglecting additional information facilitative?. In: British journal of educational technology. 2015 ; Vol. 46, No. 4. pp. 803-817.
@article{be212d57c4554fbb9c3aba82f6b3254f,
title = "Avoiding split attention in computer-based testing: is neglecting additional information facilitative?",
abstract = "This study investigated whether design guidelines for computer-based learning can be applied to computer-based testing (CBT). Twenty-two students completed a CBT exam with half of the questions presented in a split-screen format that was analogous to the original paper-and-pencil version and half in an integrated format. Results show that students attended to all information in the integrated format while ignoring information in the split format. Interestingly, and contrary to expectations, they worked more efficiently in the split format. A content analysis of the ignored information revealed that it was mostly not relevant to answering the questions, unnecessarily taxed students’ cognitive capacity and inefficiently increased the mental effort they expended. Further comparisons of different mental effort measures indicate that mental effort had an explicit (ie, self-reports, explicit utterances) and an implicit component (ie, silent pauses in thinking-aloud, eye tracking parameters). Consequently, when designing CBT environments, not only the design of the tasks but also the content of the given information and their effect on the different aspects of mental effort must be considered.",
keywords = "METIS-309456, IR-94621",
author = "Halszka Jarodzka and Noortje Janssen and Kirschner, {Paul A.} and Gijsbert Erkens",
year = "2015",
month = "6",
day = "3",
doi = "10.1111/bjet.12174",
language = "English",
volume = "46",
pages = "803--817",
journal = "British journal of educational technology",
issn = "0007-1013",
publisher = "Wiley-Blackwell",
number = "4",

}

Avoiding split attention in computer-based testing: is neglecting additional information facilitative? / Jarodzka, Halszka; Janssen, Noortje; Kirschner, Paul A.; Erkens, Gijsbert.

In: British journal of educational technology, Vol. 46, No. 4, 03.06.2015, p. 803-817.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Avoiding split attention in computer-based testing: is neglecting additional information facilitative?

AU - Jarodzka, Halszka

AU - Janssen, Noortje

AU - Kirschner, Paul A.

AU - Erkens, Gijsbert

PY - 2015/6/3

Y1 - 2015/6/3

N2 - This study investigated whether design guidelines for computer-based learning can be applied to computer-based testing (CBT). Twenty-two students completed a CBT exam with half of the questions presented in a split-screen format that was analogous to the original paper-and-pencil version and half in an integrated format. Results show that students attended to all information in the integrated format while ignoring information in the split format. Interestingly, and contrary to expectations, they worked more efficiently in the split format. A content analysis of the ignored information revealed that it was mostly not relevant to answering the questions, unnecessarily taxed students’ cognitive capacity and inefficiently increased the mental effort they expended. Further comparisons of different mental effort measures indicate that mental effort had an explicit (ie, self-reports, explicit utterances) and an implicit component (ie, silent pauses in thinking-aloud, eye tracking parameters). Consequently, when designing CBT environments, not only the design of the tasks but also the content of the given information and their effect on the different aspects of mental effort must be considered.

AB - This study investigated whether design guidelines for computer-based learning can be applied to computer-based testing (CBT). Twenty-two students completed a CBT exam with half of the questions presented in a split-screen format that was analogous to the original paper-and-pencil version and half in an integrated format. Results show that students attended to all information in the integrated format while ignoring information in the split format. Interestingly, and contrary to expectations, they worked more efficiently in the split format. A content analysis of the ignored information revealed that it was mostly not relevant to answering the questions, unnecessarily taxed students’ cognitive capacity and inefficiently increased the mental effort they expended. Further comparisons of different mental effort measures indicate that mental effort had an explicit (ie, self-reports, explicit utterances) and an implicit component (ie, silent pauses in thinking-aloud, eye tracking parameters). Consequently, when designing CBT environments, not only the design of the tasks but also the content of the given information and their effect on the different aspects of mental effort must be considered.

KW - METIS-309456

KW - IR-94621

U2 - 10.1111/bjet.12174

DO - 10.1111/bjet.12174

M3 - Article

VL - 46

SP - 803

EP - 817

JO - British journal of educational technology

JF - British journal of educational technology

SN - 0007-1013

IS - 4

ER -