The 2019 Comparison of Tools for the Analysis of Quantitative Formal Models: (QComp 2019 Competition Report)

Ernst Moritz Hahn, Arnd Hartmanns, Christian Hensel, Michaela Klauck, Joachim Klein, Jan Křetínský, David Parker, Tim Quatmann, Marcel Steinmetz, Enno Ruijters

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    13 Citations (Scopus)
    29 Downloads (Pure)

    Abstract

    Quantitative formal models capture probabilistic behaviour, real-time aspects, or general continuous dynamics. A number of tools support their automatic analysis with respect to dependability or performance properties. QComp 2019 is the first, friendly competition among such tools. It focuses on stochastic formalisms from Markov chains to probabilistic timed automata specified in the Jani model exchange format, and on probabilistic reachability, expected-reward, and steady-state properties. QComp draws its benchmarks from the new Quantitative Verification Benchmark Set. Participating tools, which include probabilistic model checkers and planners as well as simulation-based tools, are evaluated in terms of performance, versatility, and usability. In this paper, we report on the challenges in setting up a quantitative verification competition, present the results of QComp 2019, summarise the lessons learned, and provide an outlook on the features of the next edition of QComp.
    Original languageEnglish
    Title of host publicationTools and Algorithms for the Construction and Analysis of Systems
    Subtitle of host publication25 Years of TACAS: TOOLympics, Held as Part of ETAPS 2019, Prague, Czech Republic, April 6–11, 2019, Proceedings
    EditorsDirk Beyer, Marieke Huisman, Fabrice Kordon, Bernhard Steffen
    Place of PublicationCham
    PublisherSpringer
    Pages69-92
    Number of pages24
    VolumePart III
    ISBN (Electronic)978-3-030-17502-3
    ISBN (Print)978-3-030-17501-6
    DOIs
    Publication statusPublished - 2019
    Event25th International Conference on Tools and Algorithms for the Construction and Analysis of Systems conference series, TACAS 2019 - Charles University, Prague, Czech Republic
    Duration: 6 Apr 201911 Apr 2019
    Conference number: 25

    Publication series

    NameLecture Notes in Computer Science
    PublisherSpringer
    Volume11429
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference25th International Conference on Tools and Algorithms for the Construction and Analysis of Systems conference series, TACAS 2019
    Abbreviated titleTACAS 2019
    CountryCzech Republic
    CityPrague
    Period6/04/1911/04/19
    Otherheld as part of the 22nd European Joint Conferences on Theory and Practice of Software, ETAPS 2019

    Fingerprint Dive into the research topics of 'The 2019 Comparison of Tools for the Analysis of Quantitative Formal Models: (QComp 2019 Competition Report)'. Together they form a unique fingerprint.

    Cite this