The bootstrap discovery behaviour model: Why five users are not enough to test user experience

Simone Borsci, Stefano Federici, Maria Laura Mele, Domenico Polimeno, Alessandro Londei

    Research output: Chapter in Book/Report/Conference proceedingChapterAcademicpeer-review

    5 Citations (Scopus)

    Abstract

    The chapter focuses on the Bootstrap statistical technique for assigning measures of accuracy to sample estimates, here adopted for the first time to obtain an effective and efficient interaction evaluation. After introducing and discussing the classic debate on p value (i.e., the discovery detection rate) about estimation problems, the authors present the most used model for the estimation of the number of participants needed for an evaluation test, namely the Return On Investment model (ROI). Since the ROI model endorses a monodimensional and economical perspective in which an evaluation process, composed of only an expert technique, is sufficient to identify all the interaction problems-without distinguishing real problems (i.e., identified both experts and users) and false problems (i.e., identified only by experts)- they propose the new Bootstrap Discovery Behaviour (BDB) estimation model. Findings highlight the BDB as a functional technique favouring practitioners to optimize the number of participants needed for an interaction evaluation. Finally, three experiments show the application of the BDB model to create experimental sample sizes to test user experience of people with and without disabilities.

    Original languageEnglish
    Title of host publicationCognitively Informed Intelligent Interfaces
    Subtitle of host publicationSystems Design and Development
    PublisherIGI Global
    Pages258-279
    Number of pages22
    ISBN (Electronic)9781466616295
    ISBN (Print)9781466616288
    DOIs
    Publication statusPublished - 1 Dec 2012

    Fingerprint Dive into the research topics of 'The bootstrap discovery behaviour model: Why five users are not enough to test user experience'. Together they form a unique fingerprint.

  • Cite this

    Borsci, S., Federici, S., Mele, M. L., Polimeno, D., & Londei, A. (2012). The bootstrap discovery behaviour model: Why five users are not enough to test user experience. In Cognitively Informed Intelligent Interfaces: Systems Design and Development (pp. 258-279). IGI Global. https://doi.org/10.4018/978-1-4666-1628-8.ch015