Model-Based Testing of Probabilistic Systems

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    8 Citations (Scopus)
    95 Downloads (Pure)

    Abstract

    This paper presents a model-based testing framework for probabilistic systems. We provide algorithms to generate, execute and evaluate test cases from a probabilistic requirements model. In doing so, we connect ioco-theory for model-based testing and statistical hypothesis testing: our ioco-style algorithms handle the functional aspects, while statistical methods, using χ2χ2 tests and fitting functions, assess if the frequencies observed during test execution correspond to the probabilities specified in the requirements. Key results of our paper are the classical soundness and completeness properties, establishing the mathematical correctness of our framework; Soundness states that each test case is assigned the right verdict. Completeness states that the framework is powerful enough to discover each probabilistic deviation from the specification, with arbitrary precision. We illustrate the use of our framework via two case studies.
    Original languageEnglish
    Title of host publicationFundamental Approaches to Software Engineering
    Subtitle of host publication19th International Conference, FASE 2016, Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2016, Eindhoven, The Netherlands, April 2–8, 2016, Proceedings
    EditorsPerdita Stevens, Andzej Wasowski
    Place of PublicationHeidelberg-Berlin
    PublisherSpringer
    Pages251-268
    Number of pages18
    ISBN (Electronic)978-3-662-49665-7
    ISBN (Print)978-3-662-49664-0
    DOIs
    Publication statusPublished - Apr 2016
    Event19th International Conference on Fundamental Approaches to Software Engineering, FASE 2016 - Eindhoven University of Technology, Eindhoven, Netherlands
    Duration: 2 Apr 20168 Apr 2016
    Conference number: 19
    https://www.etaps.org/index.php/2016/fase

    Publication series

    NameLecture Notes in Computer Science
    PublisherSpringer Verlag
    Volume9633
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference19th International Conference on Fundamental Approaches to Software Engineering, FASE 2016
    Abbreviated titleFASE
    CountryNetherlands
    CityEindhoven
    Period2/04/168/04/16
    Internet address

    Keywords

    • FMT-FMPA: FORMAL METHODS FOR PERFORMANCE ANALYSIS
    • EC Grant Agreement nr.: FP7/318490
    • Statistical hypothesis testing
    • Trace distribution
    • False rejection
    • Probabilistic automaton
    • Finite path

    Fingerprint Dive into the research topics of 'Model-Based Testing of Probabilistic Systems'. Together they form a unique fingerprint.

  • Cite this

    Gerhold, M., & Stoelinga, M. I. A. (2016). Model-Based Testing of Probabilistic Systems. In P. Stevens, & A. Wasowski (Eds.), Fundamental Approaches to Software Engineering: 19th International Conference, FASE 2016, Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2016, Eindhoven, The Netherlands, April 2–8, 2016, Proceedings (pp. 251-268). (Lecture Notes in Computer Science; Vol. 9633). Heidelberg-Berlin: Springer. https://doi.org/10.1007/978-3-662-49665-7_15