Uniformization with Representatives - comprehensive transient analysis of infinite-state QBDs

Anne Katharina Ingrid Remke, Boudewijn R.H.M. Haverkort, L. Cloth

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    1 Citation (Scopus)
    50 Downloads (Pure)

    Abstract

    A large variety of computer and communication systems can be modeled adequately as infinite-state continuous-time Markov chains (CTMCs). A highly structured class of such infinite-state CTMCs is the class of Quasi-Birth-Death processes (QBDs), on which we focus in this paper. We present an efficient variant of uniformization for computing the transient probability $\mathbf{V}_{i,j}(t)$ of being in each state $j$ of the QBD for any possible initial state $i$ at time $t$. Note that both the set of starting states and the set of goal states have infinite size. All the probabilities $\mathbf{V}_{i,j}(t)$ are needed in the context of probabilistic model checking. The key idea of our algorithm is to split the infinite set of starting states into a finite part and an infinite (repeating) part. The transient probabilities for the infinite part are then computed using the new notion of \emph{representatives}. We present the required data structures and algorithm, as well as an application-dependent optimal stopping criterion. In a simple case study we show the feasibility of our approach, as well as the efficiency gain due to the optimal stopping criterion.
    Original languageUndefined
    Title of host publicationFirst International Conference on Performance Evaluation Methodologies and Tools
    Place of PublicationNew York
    PublisherAssociation for Computing Machinery (ACM)
    Pages7
    Number of pages10
    ISBN (Print)1-59593-506-1
    DOIs
    Publication statusPublished - 11 Oct 2006
    Event1st International Conference on Performance Evaluation Methodologies and Tools 2006 - Pisa, Italy
    Duration: 11 Oct 200613 Oct 2006
    Conference number: 1
    http://archive.valuetools.org/2006/

    Publication series

    Name
    PublisherACM
    Number2

    Conference

    Conference1st International Conference on Performance Evaluation Methodologies and Tools 2006
    Abbreviated titleVALUETOOLS 2006
    CountryItaly
    CityPisa
    Period11/10/0613/10/06
    Internet address

    Keywords

    • METIS-238165
    • EWI-6897
    • IR-66348

    Cite this