Abstract
Statistical model checking uses Monte Carlo simulation to analyse stochastic formal models. It avoids state space explosion, but requires rare event simulation techniques to efficiently estimate very low probabilities. One such technique is RESTART. Villén-Altamirano recently showed—by way of a theoretical study and ad-hoc implementation—that a generalisation of RESTART to prolonged retrials offers improved performance. In this paper, we demonstrate our independent replication of the original experimental results. We implemented RESTART with prolonged retrials in the and modes tools, and apply them to the models used originally. To do so, we had to resolve ambiguities in the original work, and refine our setup multiple times. We ultimately confirm the previous results, but our experience also highlights the need for precise documentation of experiments to enable replicability in computer science.
Original language | English |
---|---|
Title of host publication | Tools and Algorithms for the Construction and Analysis of Systems- 26th International Conference, TACAS 2020, held as part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2020, Proceedings, Part I |
Editors | Jan Friso Groote, Kim Guldstrand Larsen |
Publisher | Springer |
Pages | 373-380 |
Number of pages | 8 |
ISBN (Electronic) | 978-3-030-72013-1 |
ISBN (Print) | 978-3-030-72012-4 |
DOIs | |
Publication status | Published - 23 Mar 2021 |
Event | 27th International Conference on Tools and Algorithms for the Construction and Analysis of Systems, TACAS 2021 - Online Event Duration: 27 Mar 2021 → 1 Apr 2021 Conference number: 27 |
Publication series
Name | Lecture Notes in Computer Science |
---|---|
Volume | LNCS 12652 |
ISSN (Print) | 0302-9743 |
ISSN (Electronic) | 1611-3349 |
Conference
Conference | 27th International Conference on Tools and Algorithms for the Construction and Analysis of Systems, TACAS 2021 |
---|---|
Abbreviated title | TACAS 2021 |
City | Online Event |
Period | 27/03/21 → 1/04/21 |
Other | Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2021 |