Mean field variational approximation for continuous-time Bayesian networks

Ido Cohn*, Tal El-Hay, Nir Friedman, Raz Kupferman

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

34 Scopus citations

Abstract

Continuous-time Bayesian networks is a natural structured representation language for multicomponent stochastic processes that evolve continuously over time. Despite the compact representation provided by this language, inference in such models is intractable even in relatively simple structured networks. We introduce a mean field variational approximation in which we use a product of inhomogeneous Markov processes to approximate a joint distribution over trajectories. This variational approach leads to a globally consistent distribution, which can be efficiently queried. Additionally, it provides a lower bound on the probability of observations, thus making it attractive for learning tasks. Here we describe the theoretical foundations for the approximation, an efficient implementation that exploits the wide range of highly optimized ordinary differential equations (ODE) solvers, experimentally explore characterizations of processes for which this approximation is suitable, and show applications to a large-scale real-world inference problem.

Original languageAmerican English
Pages (from-to)2745-2783
Number of pages39
JournalJournal of Machine Learning Research
Volume11
StatePublished - Oct 2010

Keywords

  • Continuous time Bayesian networks
  • Continuous time Markov processes
  • Mean field approximation
  • Variational approximations

Fingerprint

Dive into the research topics of 'Mean field variational approximation for continuous-time Bayesian networks'. Together they form a unique fingerprint.

Cite this