Interpreting a Successful Testing Process: Risk and Actual Coverage

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    Abstract

    Testing is inherently incomplete; no test suite will ever be able to test all possible usage scenarios of a system. It is therefore vital to assess the implication of a system passing a test suite. This paper quantifies that implication by means of two distinct, but related, measures: the risk quantifies the confidence in a system after it passes a test suite, i.e., the number of faults still expected to be present (weighted by their severity); the actual coverage quantifies the extent to which faults have been shown absent, i.e., the fraction of possible faults that has been covered. We provide evaluation algorithms that calculate these metrics for a given test suite, as well as optimisation algorithms that yield the best test suite for a given optimisation criterion.
    Original languageEnglish
    Title of host publicationProceedings of the 3rd IEEE International Symposium on Theoretical Aspects of Software Engineering (TASE)
    EditorsW.N. Chin, S. Qin
    Place of PublicationLos Alamitos
    PublisherIEEE Computer Society
    Pages251-258
    Number of pages8
    ISBN (Print)978-0-7695-3757-3
    DOIs
    Publication statusPublished - Jul 2009
    Event3rd IEEE International Symposium on Theoretical Aspects of Software Engineering, TASE 2009 - Tianjin, China
    Duration: 29 Jul 200931 Jul 2009
    Conference number: 3
    https://www.scm.tees.ac.uk/s.qin/tase2009/

    Conference

    Conference3rd IEEE International Symposium on Theoretical Aspects of Software Engineering, TASE 2009
    Abbreviated titleTASE
    CountryChina
    CityTianjin
    Period29/07/0931/07/09
    Internet address

    Keywords

    • METIS-263966
    • IR-67564
    • Risk
    • Coverage
    • EC Grant Agreement nr.: FP7-ICT-2007-1
    • Probabilistic
    • EWI-15837
    • EC Grant Agreement nr.: FP7/214755
    • Formal testing

    Fingerprint Dive into the research topics of 'Interpreting a Successful Testing Process: Risk and Actual Coverage'. Together they form a unique fingerprint.

    Cite this