Selective Monitoring

06/15/2018
by   Radu Grigore, et al.
0

We study selective monitors for labelled Markov chains. Monitors observe the outputs that are generated by a Markov chain during its run, with the goal of identifying runs as correct or faulty. A monitor is selective if it skips observations in order to reduce monitoring overhead. We are interested in monitors that minimize the expected number of observations. We establish an undecidability result for selectively monitoring general Markov chains. On the other hand, we show for non-hidden Markov chains (where any output identifies the state the Markov chain is in) that simple optimal monitors exist and can be computed efficiently, based on DFA language equivalence. These monitors do not depend on the precise transition probabilities in the Markov chain. We report on experiments where we compute these monitors for several open-source Java projects.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/12/2022

Markov Observation Models

Herein, the Hidden Markov Model is expanded to allow for Markov chain ob...
research
01/11/2021

Hidden Markov chains and fields with observations in Riemannian manifolds

Hidden Markov chain, or Markov field, models, with observations in a Euc...
research
04/02/2020

Robust Parametric Inference for Finite Markov Chains

We consider the problem of statistical inference in a parametric finite ...
research
10/27/2015

Statistically efficient thinning of a Markov chain sampler

It is common to subsample Markov chain output to reduce the storage burd...
research
07/13/2020

The Distribution Function of the Longest Head Run

In this paper, the open problem of finding a closed analytical expressio...
research
12/30/2019

Variable Length Markov Chain with Exogenous Covariates

Markov Chains with variable length are useful stochastic models for data...
research
04/28/2023

MCPrioQ: A lock-free algorithm for online sparse markov-chains

In high performance systems it is sometimes hard to build very large gra...

Please sign up or login with your details

Forgot password? Click here to reset