Abstract
We provide a memory-efficient algorithm for multi-objective model checking problems on Markov decision processes (MDPs) with multiple cost structures. The key problem at hand is to check whether there exists a scheduler for a given MDP such that all objectives over cost vectors are fulfilled. We cover multi-objective reachability and expected cost objectives, and combinations thereof. We further transfer approaches for computing quantiles over single cost bounds to the multi-cost case and highlight the ensuing challenges. An empirical evaluation shows the scalability of our new approach both in terms of memory consumption and runtime. We discuss the need for more detailed visual presentations of results beyond Pareto curves and present a first visualisation approach that exploits all the available information from the algorithm to support decision makers.
| Original language | English |
|---|---|
| Pages (from-to) | 1483-1522 |
| Number of pages | 40 |
| Journal | Journal of automated reasoning |
| Volume | 64 |
| Issue number | 7 |
| Early online date | 28 Jul 2020 |
| DOIs | |
| Publication status | Published - Oct 2020 |
Keywords
- Markov decision process
- Multi-objective verification
- Pareto-optimal strategies
- Cost-bounded reachability
- Expected rewards
- Probabilistic model checking
Fingerprint
Dive into the research topics of 'Multi-cost Bounded Tradeoff Analysis in MDP'. Together they form a unique fingerprint.Datasets
-
Multi-Cost Bounded Tradeoff Analysis in MDP - Artifact
Hartmanns, A. (Creator), Junges, S. (Creator), Katoen, J.-P. (Creator) & Quatmann, T. (Creator), Zenodo, 15 Jun 2020
DOI: 10.5281/zenodo.3894716, https://zenodo.org/record/3894716 and 4 more links, https://doi.org/10.5281/zenodo.3894717, https://zenodo.org/record/3894717, https://doi.org/10.5281/zenodo.3894735, https://zenodo.org/record/3894735 (show fewer)
Dataset
Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver