A Unified Checklist for Observational and Experimental Research in Software Engineering (Version 1)

Roelf J. Wieringa

    Research output: Book/ReportReportProfessional

    795 Downloads (Pure)

    Abstract

    Current checklists for empirical software engineering cover either experimental research or case study research but ignore the many commonalities that exist across all kinds of empirical research. Identifying these commonalities, and explaining why they exist, would enhance our understanding of empirical research in general and of the differences between experimental and case study research in particular. In this report we design a unified checklist for empirical research, and identify commonalities and differences between experimental and case study research. We design the unified checklist as a specialization of the general engineering cycle, which itself is a special case of the rational choice cycle. We then compare the resulting empirical research cycle with two checklists for experimental research, and with one checklist for case study research. The resulting checklist identifies important questions to be answered in experimental and case study research design and reports. The checklist provides insights in two different types of empirical research design and their relationships. Its limitations are that it ignores other research methods such as meta-research or surveys. It has been tested so far only in our own research designs and in teaching empirical methods. Future work includes expanding the comparison with other methods and application in more cases, by others than ourselves.
    Original languageUndefined
    Place of PublicationEnschede
    PublisherCentre for Telematics and Information Technology (CTIT)
    Number of pages11
    Publication statusPublished - 2 Mar 2012

    Publication series

    NameCTIT Technical Report Series
    PublisherUniversity of Twente, Centre for Telematics and Information Technology
    No.TR-CTIT-12-07
    ISSN (Print)1381-3625

    Keywords

    • SCS-Services
    • IR-79890
    • EWI-21630
    • IS-Design science methodology
    • METIS-285167

    Cite this

    Wieringa, R. J. (2012). A Unified Checklist for Observational and Experimental Research in Software Engineering (Version 1). (CTIT Technical Report Series; No. TR-CTIT-12-07). Enschede: Centre for Telematics and Information Technology (CTIT).