Web usability evaluation with screen reader users: Implementation of the partial concurrent thinking aloud technique

Stefano Federici*, Simone Borsci, Gianluca Stamerra

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

27 Citations (Scopus)
15 Downloads (Pure)

Abstract

A verbal protocol technique, adopted for a web usability evaluation, requires that the users are able to perform a double task: surfing and talking. Nevertheless, when blind users surf by using a screen reader and talk about the way they interact with the computer, the evaluation is influenced by a structural interference: users are forced to think aloud and listen to the screen reader at the same time. The aim of this study is to build up a verbal protocol technique for samples of visual impaired users in order to overcome the limits of concurrent and retrospective protocols. The technique we improved, called partial concurrent thinking aloud (PCTA), integrates a modified set of concurrent verbalization and retrospective analysis. One group of 6 blind users and another group of 6 sighted users evaluated the usability of a website using PCTA. By estimating the number of necessary users by the means of an asymptotic test, it was found out that the two groups had an equivalent ability of identifying usability problems, both over 80%. The result suggests that PCTA, while respecting the properties of classic verbal protocols, also allows to overcome the structural interference and the limits of concurrent and retrospective protocols when used with screen reader users. In this way, PCTA reduces the efficiency difference of usability evaluation between blind and sighted users.

Original languageEnglish
Pages (from-to)263-272
Number of pages10
JournalCognitive processing
Volume11
Issue number3
DOIs
Publication statusPublished - 1 Aug 2010
Externally publishedYes

Keywords

  • Asymptotic test
  • Human computer interaction
  • Thinking aloud
  • Usability evaluation
  • n/a OA procedure

Fingerprint

Dive into the research topics of 'Web usability evaluation with screen reader users: Implementation of the partial concurrent thinking aloud technique'. Together they form a unique fingerprint.

Cite this