The Quantitative Verification Benchmark Set

Arnd Hartmanns, Michaela Klauck, David Parker, Tim Quatmann, Enno Jozef Johannes Ruijters

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    5 Citations (Scopus)
    19 Downloads (Pure)

    Abstract

    We present an extensive collection of quantitative models to facilitate the development, comparison, and benchmarking of new verification algorithms and tools. All models have a formal semantics in terms of extensions of Markov chains, are provided in the Jani format, and are documented by a comprehensive set of metadata. The collection is highly diverse: it includes established probabilistic verification and planning benchmarks, industrial case studies, models of biological systems, dynamic fault trees, and Petri net examples, all originally specified in a variety of modelling languages. It archives detailed tool performance data for each model, enabling immediate comparisons between tools and among tool versions over time. The collection is easy to access via a client-side web application at qcomp.org with powerful search and visualisation features. It can be extended via a Git-based submission process, and is openly accessible according to the terms of the CC-BY license.
    Original languageEnglish
    Title of host publicationProceedings of the 25th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS 2019)
    EditorsTomáš Vojnar, Lijun Zhang
    PublisherSpringer
    Pages344-350
    ISBN (Electronic)978-3-030-17462-0
    ISBN (Print)978-3-030-17461-3
    DOIs
    Publication statusPublished - 4 Apr 2019
    Event25th International Conference on Tools and Algorithms for the Construction and Analysis of Systems conference series, TACAS 2019 - Charles University, Prague, Czech Republic
    Duration: 6 Apr 201911 Apr 2019
    Conference number: 25

    Publication series

    NameLecture Notes in Computer Science
    PublisherSpringer
    Volume11427
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference25th International Conference on Tools and Algorithms for the Construction and Analysis of Systems conference series, TACAS 2019
    Abbreviated titleTACAS 2019
    CountryCzech Republic
    CityPrague
    Period6/04/1911/04/19
    Otherheld as part of the 22nd European Joint Conferences on Theory and Practice of Software, ETAPS 2019

    Fingerprint Dive into the research topics of 'The Quantitative Verification Benchmark Set'. Together they form a unique fingerprint.

  • Cite this

    Hartmanns, A., Klauck, M., Parker, D., Quatmann, T., & Ruijters, E. J. J. (2019). The Quantitative Verification Benchmark Set. In T. Vojnar, & L. Zhang (Eds.), Proceedings of the 25th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS 2019) (pp. 344-350). (Lecture Notes in Computer Science; Vol. 11427). Springer. https://doi.org/10.1007/978-3-030-17462-0_20