An Experimental Evaluation of a Unified Checklist for Designing and Reporting Empirical Research in Software Engineering

Nelly Condori-Fernandez, Roelf J. Wieringa, Maia Daneva, B.B. Mutschler, Oscar Pastor

    Research output: Book/ReportReportProfessional

    67 Downloads (Pure)


    This article reports on an experimental evaluation of a unified checklist for case study and experimental research. The checklist aims at exhibiting the underlying, shared, structure of observational and experimental research, and is based on several published checklist in software engineering and other disciplines. We asked a small sample of subjects to apply it to two papers, one reporting on a case study and one reporting on an experiment. After this experience, we collected their perceptions of the perceived ease of use and usefulness of the checklist. The outcome reveals that respondents find some of the concepts used in the checklist hard to understand, thus difficult to be used by the subjects (researchers). However they also think a unified checklist like this would be useful for their empirical research. We discuss the findings and their limitations, and infer some implications for improving the checklist.
    Original languageUndefined
    Place of PublicationEnschede
    PublisherCentre for Telematics and Information Technology (CTIT)
    Number of pages15
    Publication statusPublished - 14 May 2012

    Publication series

    NameCTIT Technical Report Series
    PublisherUniversity of Twente, Centre for Telematics and Information Technology (CTIT)
    ISSN (Print)1381-3625


    • METIS-296061
    • understandability
    • IR-80342
    • SCS-Services
    • CR-D.2
    • perceived ease of use
    • perceived usefulness
    • Experimental evaluation
    • SE-SMM: Software Measurement and Metrics
    • IS-Design science methodology
    • EWI-21832

    Cite this