Computing continuous-time Markov chains as transformers of unbounded observables

Publikation: Bidrag til bog/antologi/rapportKonferencebidrag i proceedingsForskningfagfællebedømt

The paper studies continuous-time Markov chains (CTMCs) as transformers of real-valued functions on their state space, considered as generalised predicates and called observables. Markov chains are assumed to take values in a countable state space S; observables f: S → ℝ may be unbounded. The interpretation of CTMCs as transformers of observables is via their transition function Pt: each observable f is mapped to the observable Ptf that, in turn, maps each state x to the mean value of f at time t conditioned on being in state x at time 0. The first result is computability of the time evolution of observables, i.e., maps of the form (t, f) ↦ Ptf, under conditions that imply existence of a Banach sequence space of observables on which the transition function Pt of a fixed CTMC induces a family of bounded linear operators that vary continuously in time (w.r.t. the usual topology on bounded operators). The second result is PTIME-computability of the projections t ↦ (Ptf)(x), for each state x, provided that the rate matrix of the CTMC Xt is locally algebraic on a subspace containing the observable f. The results are flexible enough to accommodate unbounded observables; explicit examples feature the token counts in stochastic Petri nets and sub-string occurrences of stochastic string rewriting systems. The results provide a functional analytic alternative to Monte Carlo simulation as test bed for mean-field approximations, moment closure, and similar techniques that are fast, but lack absolute error guarantees.

OriginalsprogEngelsk
TitelFoundations of Software Science and Computation Structures : 20th International Conference, FOSSACS 2017, Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2017, Uppsala, Sweden, April 22-29, 2017, Proceedings
RedaktørerJavier Esparza, Andrzej S. Murawski
Antal sider17
ForlagSpringer
Publikationsdato2017
Sider338-354
ISBN (Trykt)978-3-662-54457-0
ISBN (Elektronisk)978-3-662-54458-7
DOI
StatusUdgivet - 2017
Begivenhed20th International Conference on Foundations of Software Science and Computation Structures - Uppsala, Sverige
Varighed: 22 apr. 201729 apr. 2017
Konferencens nummer: 20

Konference

Konference20th International Conference on Foundations of Software Science and Computation Structures
Nummer20
LandSverige
ByUppsala
Periode22/04/201729/04/2017
NavnLecture notes in computer science
Vol/bind10203
ISSN0302-9743

ID: 179559963