Bisimulation and Logical Preservation for Continuous-Time Markov Decision Processes

Martin R. Neuhausser; Joost-Pieter Katoen

doi:10.1007/978-3-540-74407-8_28

Bisimulation and Logical Preservation for Continuous-Time Markov Decision Processes

Martin R. Neuhausser, Joost-Pieter Katoen

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

21 Citations (Scopus)

Abstract

This paper introduces strong bisimulation for continuous-time Markov decision processes (CTMDPs), a stochastic model which allows for a nondeterministic choice between exponential distributions, and shows that bisimulation preserves the validity of CSL. To that end, we interpret the semantics of CSL - a stochastic variant of CTL for continuous-time Markov chains - on CTMDPs and show its measure theoretic soundness. The main challenge faced in this paper is the proof of logical preservation that is substantially based on measure theory.

Original language	English
Title of host publication	CONCUR 2007 – Concurrency Theory
Subtitle of host publication	18th International Conference, CONCUR 2007, Lisbon, Portugal, September 3-8, 2007. Proceedings
Place of Publication	London
Publisher	Springer
Pages	412-427
Number of pages	16
ISBN (Electronic)	978-3-540-74407-8
ISBN (Print)	978-3-540-74406-1
DOIs	https://doi.org/10.1007/978-3-540-74407-8_28
Publication status	Published - Sep 2007
Event	18th International Conference on Concurrency Theory, CONCUR 2007 - Lisbon, Portugal Duration: 3 Sep 2007 → 8 Sep 2007 Conference number: 18

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	4703
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	18th International Conference on Concurrency Theory, CONCUR 2007
Abbreviated title	CONCUR
Country	Portugal
City	Lisbon
Period	3/09/07 → 8/09/07

Keywords

Continuous-time Markov decision process (CTMDP)

Access to Document

10.1007/978-3-540-74407-8_28

Neuhausser2007bisimulation
restricted
Accepted author version, 258 KB

Fingerprint Dive into the research topics of 'Bisimulation and Logical Preservation for Continuous-Time Markov Decision Processes'. Together they form a unique fingerprint.

Cite this

Neuhausser, M. R., & Katoen, J-P. (2007). Bisimulation and Logical Preservation for Continuous-Time Markov Decision Processes. In CONCUR 2007 – Concurrency Theory: 18th International Conference, CONCUR 2007, Lisbon, Portugal, September 3-8, 2007. Proceedings (pp. 412-427). (Lecture Notes in Computer Science; Vol. 4703). Springer. https://doi.org/10.1007/978-3-540-74407-8_28

@inproceedings{960bed9aeab946a99c5a346e9a6b61c7,

title = "Bisimulation and Logical Preservation for Continuous-Time Markov Decision Processes",

abstract = "This paper introduces strong bisimulation for continuous-time Markov decision processes (CTMDPs), a stochastic model which allows for a nondeterministic choice between exponential distributions, and shows that bisimulation preserves the validity of CSL. To that end, we interpret the semantics of CSL - a stochastic variant of CTL for continuous-time Markov chains - on CTMDPs and show its measure theoretic soundness. The main challenge faced in this paper is the proof of logical preservation that is substantially based on measure theory.",

keywords = "Continuous-time Markov decision process (CTMDP)",

author = "Neuhausser, {Martin R.} and Joost-Pieter Katoen",

year = "2007",

month = sep,

doi = "10.1007/978-3-540-74407-8_28",

language = "English",

isbn = "978-3-540-74406-1",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "412--427",

booktitle = "CONCUR 2007 – Concurrency Theory",

note = "18th International Conference on Concurrency Theory, CONCUR 2007, CONCUR ; Conference date: 03-09-2007 Through 08-09-2007",

}

Neuhausser, MR & Katoen, J-P 2007, Bisimulation and Logical Preservation for Continuous-Time Markov Decision Processes. in CONCUR 2007 – Concurrency Theory: 18th International Conference, CONCUR 2007, Lisbon, Portugal, September 3-8, 2007. Proceedings. Lecture Notes in Computer Science, vol. 4703, Springer, London, pp. 412-427, 18th International Conference on Concurrency Theory, CONCUR 2007, Lisbon, Portugal, 3/09/07. https://doi.org/10.1007/978-3-540-74407-8_28

Bisimulation and Logical Preservation for Continuous-Time Markov Decision Processes. / Neuhausser, Martin R.; Katoen, Joost-Pieter.

CONCUR 2007 – Concurrency Theory: 18th International Conference, CONCUR 2007, Lisbon, Portugal, September 3-8, 2007. Proceedings. London : Springer, 2007. p. 412-427 (Lecture Notes in Computer Science; Vol. 4703).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Bisimulation and Logical Preservation for Continuous-Time Markov Decision Processes

AU - Neuhausser, Martin R.

AU - Katoen, Joost-Pieter

N1 - Conference code: 18

PY - 2007/9

Y1 - 2007/9

N2 - This paper introduces strong bisimulation for continuous-time Markov decision processes (CTMDPs), a stochastic model which allows for a nondeterministic choice between exponential distributions, and shows that bisimulation preserves the validity of CSL. To that end, we interpret the semantics of CSL - a stochastic variant of CTL for continuous-time Markov chains - on CTMDPs and show its measure theoretic soundness. The main challenge faced in this paper is the proof of logical preservation that is substantially based on measure theory.

AB - This paper introduces strong bisimulation for continuous-time Markov decision processes (CTMDPs), a stochastic model which allows for a nondeterministic choice between exponential distributions, and shows that bisimulation preserves the validity of CSL. To that end, we interpret the semantics of CSL - a stochastic variant of CTL for continuous-time Markov chains - on CTMDPs and show its measure theoretic soundness. The main challenge faced in this paper is the proof of logical preservation that is substantially based on measure theory.

KW - Continuous-time Markov decision process (CTMDP)

U2 - 10.1007/978-3-540-74407-8_28

DO - 10.1007/978-3-540-74407-8_28

M3 - Conference contribution

SN - 978-3-540-74406-1

T3 - Lecture Notes in Computer Science

SP - 412

EP - 427

BT - CONCUR 2007 – Concurrency Theory

PB - Springer

CY - London

T2 - 18th International Conference on Concurrency Theory, CONCUR 2007

Y2 - 3 September 2007 through 8 September 2007

ER -