Interpreting a Successful Testing Process: Risk and Actual Coverage

    Research output: Book/ReportReportAcademic

    2 Citations (Scopus)
    45 Downloads (Pure)

    Abstract

    Testing is inherently incomplete; no test suite will ever be able to test all possible usage scenarios of a system. It is therefore vital to assess the implication of a system passing a test suite. This paper quantifies that implication by means of two distinct, but related, measures: the risk quantifies the confidence in a system after it passes a test suite, i.e., the number of faults still expected to be present (weighted by their severity); the actual coverage quantifies the extent to which faults have been shown absent, i.e., the fraction of possible faults that has been covered. We provide evaluation algorithms that calculate these metrics for a given test suite, as well as optimisation algorithms that yield the best test suite for a given optimisation criterion.
    Original languageUndefined
    Place of PublicationEnschede
    PublisherCentre for Telematics and Information Technology (CTIT)
    Number of pages24
    Publication statusPublished - 7 May 2009

    Publication series

    NameCTIT Technical Report Series
    PublisherUniversity of Twente, Centre for Telematica and Information Technology (CTIT)
    No.TR-CTIT-09-17
    ISSN (Print)1381-3625

    Keywords

    • EWI-15330
    • Risk
    • Formal testing
    • METIS-263837
    • Coverage
    • Probabilistic
    • IR-65483

    Cite this

    Stoelinga, M. I. A., & Timmer, M. (2009). Interpreting a Successful Testing Process: Risk and Actual Coverage. (CTIT Technical Report Series; No. TR-CTIT-09-17). Enschede: Centre for Telematics and Information Technology (CTIT).