The partial concurrent thinking aloud: A new usability evaluation technique for blind users

Simone Borsci, Stefano Federici

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    10 Citations (Scopus)

    Abstract

    The aim of this study is to build up a verbal protocol technique for samples of visual impaired users in order to overcome the limits of concurrent and retrospective protocols. Indeed, when blind users surf using a screen reader and talk about the way they interact with the computer, the evaluation is influenced by a structural interference. Users are force to think aloud and listen to the screen reader at the same time. The technique we improved, called Partial Concurrent Thinking Aloud (PCTA), integrates a modified set of concurrent verbalization and retrospective analysis. One group of 6 blind user and another group of 6 sighted users evaluated the usability of a website by PCTA. Estimating the number of users needed with an asymptotic test, we found out that the two groups had an equivalent ability of identifying usability problems, both over 80%. The result suggest that PCTA, even respecting the properties of classic verbal protocols, also allows to overcome the structural interference and the limits of concurrent and retrospective protocols when used with screen-reader users.

    Original languageEnglish
    Title of host publicationAssistive Technology from Adapted Equipment to Inclusive Environments. AAATE 2009
    Pages421-425
    Number of pages5
    DOIs
    Publication statusPublished - 1 Dec 2009

    Publication series

    NameAssistive Technology Research Series
    Volume25
    ISSN (Print)1383-813X
    ISSN (Electronic)1879-8071

    Fingerprint

    Network protocols
    Websites

    Keywords

    • Asymptotic test
    • Blindness
    • Thinking aloud
    • Usability evaluation

    Cite this

    Borsci, S., & Federici, S. (2009). The partial concurrent thinking aloud: A new usability evaluation technique for blind users. In Assistive Technology from Adapted Equipment to Inclusive Environments. AAATE 2009 (pp. 421-425). (Assistive Technology Research Series; Vol. 25). https://doi.org/10.3233/978-1-60750-042-1-421
    Borsci, Simone ; Federici, Stefano. / The partial concurrent thinking aloud : A new usability evaluation technique for blind users. Assistive Technology from Adapted Equipment to Inclusive Environments. AAATE 2009. 2009. pp. 421-425 (Assistive Technology Research Series).
    @inproceedings{7f117c3601ba4b1581e2ea70d8b64446,
    title = "The partial concurrent thinking aloud: A new usability evaluation technique for blind users",
    abstract = "The aim of this study is to build up a verbal protocol technique for samples of visual impaired users in order to overcome the limits of concurrent and retrospective protocols. Indeed, when blind users surf using a screen reader and talk about the way they interact with the computer, the evaluation is influenced by a structural interference. Users are force to think aloud and listen to the screen reader at the same time. The technique we improved, called Partial Concurrent Thinking Aloud (PCTA), integrates a modified set of concurrent verbalization and retrospective analysis. One group of 6 blind user and another group of 6 sighted users evaluated the usability of a website by PCTA. Estimating the number of users needed with an asymptotic test, we found out that the two groups had an equivalent ability of identifying usability problems, both over 80{\%}. The result suggest that PCTA, even respecting the properties of classic verbal protocols, also allows to overcome the structural interference and the limits of concurrent and retrospective protocols when used with screen-reader users.",
    keywords = "Asymptotic test, Blindness, Thinking aloud, Usability evaluation",
    author = "Simone Borsci and Stefano Federici",
    year = "2009",
    month = "12",
    day = "1",
    doi = "10.3233/978-1-60750-042-1-421",
    language = "English",
    isbn = "9781607500421",
    series = "Assistive Technology Research Series",
    pages = "421--425",
    booktitle = "Assistive Technology from Adapted Equipment to Inclusive Environments. AAATE 2009",

    }

    Borsci, S & Federici, S 2009, The partial concurrent thinking aloud: A new usability evaluation technique for blind users. in Assistive Technology from Adapted Equipment to Inclusive Environments. AAATE 2009. Assistive Technology Research Series, vol. 25, pp. 421-425. https://doi.org/10.3233/978-1-60750-042-1-421

    The partial concurrent thinking aloud : A new usability evaluation technique for blind users. / Borsci, Simone; Federici, Stefano.

    Assistive Technology from Adapted Equipment to Inclusive Environments. AAATE 2009. 2009. p. 421-425 (Assistive Technology Research Series; Vol. 25).

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    TY - GEN

    T1 - The partial concurrent thinking aloud

    T2 - A new usability evaluation technique for blind users

    AU - Borsci, Simone

    AU - Federici, Stefano

    PY - 2009/12/1

    Y1 - 2009/12/1

    N2 - The aim of this study is to build up a verbal protocol technique for samples of visual impaired users in order to overcome the limits of concurrent and retrospective protocols. Indeed, when blind users surf using a screen reader and talk about the way they interact with the computer, the evaluation is influenced by a structural interference. Users are force to think aloud and listen to the screen reader at the same time. The technique we improved, called Partial Concurrent Thinking Aloud (PCTA), integrates a modified set of concurrent verbalization and retrospective analysis. One group of 6 blind user and another group of 6 sighted users evaluated the usability of a website by PCTA. Estimating the number of users needed with an asymptotic test, we found out that the two groups had an equivalent ability of identifying usability problems, both over 80%. The result suggest that PCTA, even respecting the properties of classic verbal protocols, also allows to overcome the structural interference and the limits of concurrent and retrospective protocols when used with screen-reader users.

    AB - The aim of this study is to build up a verbal protocol technique for samples of visual impaired users in order to overcome the limits of concurrent and retrospective protocols. Indeed, when blind users surf using a screen reader and talk about the way they interact with the computer, the evaluation is influenced by a structural interference. Users are force to think aloud and listen to the screen reader at the same time. The technique we improved, called Partial Concurrent Thinking Aloud (PCTA), integrates a modified set of concurrent verbalization and retrospective analysis. One group of 6 blind user and another group of 6 sighted users evaluated the usability of a website by PCTA. Estimating the number of users needed with an asymptotic test, we found out that the two groups had an equivalent ability of identifying usability problems, both over 80%. The result suggest that PCTA, even respecting the properties of classic verbal protocols, also allows to overcome the structural interference and the limits of concurrent and retrospective protocols when used with screen-reader users.

    KW - Asymptotic test

    KW - Blindness

    KW - Thinking aloud

    KW - Usability evaluation

    UR - http://www.scopus.com/inward/record.url?scp=84865405715&partnerID=8YFLogxK

    U2 - 10.3233/978-1-60750-042-1-421

    DO - 10.3233/978-1-60750-042-1-421

    M3 - Conference contribution

    SN - 9781607500421

    T3 - Assistive Technology Research Series

    SP - 421

    EP - 425

    BT - Assistive Technology from Adapted Equipment to Inclusive Environments. AAATE 2009

    ER -

    Borsci S, Federici S. The partial concurrent thinking aloud: A new usability evaluation technique for blind users. In Assistive Technology from Adapted Equipment to Inclusive Environments. AAATE 2009. 2009. p. 421-425. (Assistive Technology Research Series). https://doi.org/10.3233/978-1-60750-042-1-421