Abstract
This paper presents a model-based testing framework for probabilistic systems. We provide algorithms to generate, execute and evaluate test cases from a probabilistic requirements model. In doing so, we connect ioco-theory for model-based testing and statistical hypothesis testing: our ioco-style algorithms handle the functional aspects, while statistical methods, using χ2χ2 tests and fitting functions, assess if the frequencies observed during test execution correspond to the probabilities specified in the requirements.
Key results of our paper are the classical soundness and completeness properties, establishing the mathematical correctness of our framework; Soundness states that each test case is assigned the right verdict. Completeness states that the framework is powerful enough to discover each probabilistic deviation from the specification, with arbitrary precision.
We illustrate the use of our framework via two case studies.
Original language | English |
---|---|
Title of host publication | Fundamental Approaches to Software Engineering |
Subtitle of host publication | 19th International Conference, FASE 2016, Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2016, Eindhoven, The Netherlands, April 2–8, 2016, Proceedings |
Editors | Perdita Stevens, Andzej Wasowski |
Place of Publication | Heidelberg-Berlin |
Publisher | Springer |
Pages | 251-268 |
Number of pages | 18 |
ISBN (Electronic) | 978-3-662-49665-7 |
ISBN (Print) | 978-3-662-49664-0 |
DOIs | |
Publication status | Published - Apr 2016 |
Event | 19th International Conference on Fundamental Approaches to Software Engineering, FASE 2016 - Eindhoven University of Technology, Eindhoven, Netherlands Duration: 2 Apr 2016 → 8 Apr 2016 Conference number: 19 https://www.etaps.org/index.php/2016/fase |
Publication series
Name | Lecture Notes in Computer Science |
---|---|
Publisher | Springer Verlag |
Volume | 9633 |
ISSN (Print) | 0302-9743 |
ISSN (Electronic) | 1611-3349 |
Conference
Conference | 19th International Conference on Fundamental Approaches to Software Engineering, FASE 2016 |
---|---|
Abbreviated title | FASE |
Country/Territory | Netherlands |
City | Eindhoven |
Period | 2/04/16 → 8/04/16 |
Internet address |
Keywords
- FMT-FMPA: FORMAL METHODS FOR PERFORMANCE ANALYSIS
- EC Grant Agreement nr.: FP7/318490
- Statistical hypothesis testing
- Trace distribution
- False rejection
- Probabilistic automaton
- Finite path