Computing continuous-time Markov chains as transformers of unbounded observables

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

The paper studies continuous-time Markov chains (CTMCs) as transformers of real-valued functions on their state space, considered as generalised predicates and called observables. Markov chains are assumed to take values in a countable state space S; observables f: S → ℝ may be unbounded. The interpretation of CTMCs as transformers of observables is via their transition function Pt: each observable f is mapped to the observable Ptf that, in turn, maps each state x to the mean value of f at time t conditioned on being in state x at time 0. The first result is computability of the time evolution of observables, i.e., maps of the form (t, f) ↦ Ptf, under conditions that imply existence of a Banach sequence space of observables on which the transition function Pt of a fixed CTMC induces a family of bounded linear operators that vary continuously in time (w.r.t. the usual topology on bounded operators). The second result is PTIME-computability of the projections t ↦ (Ptf)(x), for each state x, provided that the rate matrix of the CTMC Xt is locally algebraic on a subspace containing the observable f. The results are flexible enough to accommodate unbounded observables; explicit examples feature the token counts in stochastic Petri nets and sub-string occurrences of stochastic string rewriting systems. The results provide a functional analytic alternative to Monte Carlo simulation as test bed for mean-field approximations, moment closure, and similar techniques that are fast, but lack absolute error guarantees.

Original languageEnglish
Title of host publicationFoundations of Software Science and Computation Structures : 20th International Conference, FOSSACS 2017, Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2017, Uppsala, Sweden, April 22-29, 2017, Proceedings
EditorsJavier Esparza, Andrzej S. Murawski
Number of pages17
PublisherSpringer
Publication date2017
Pages338-354
ISBN (Print)978-3-662-54457-0
ISBN (Electronic)978-3-662-54458-7
DOIs
Publication statusPublished - 2017
Event20th International Conference on Foundations of Software Science and Computation Structures - Uppsala, Sweden
Duration: 22 Apr 201729 Apr 2017
Conference number: 20

Conference

Conference20th International Conference on Foundations of Software Science and Computation Structures
Nummer20
LandSweden
ByUppsala
Periode22/04/201729/04/2017
SeriesLecture notes in computer science
Volume10203
ISSN0302-9743

ID: 179559963