Entropy and recurrence rates for stationary random fields

Donald Ornstein*, Benjamin Weiss

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

19 Scopus citations

Abstract

For a stationary random field {x(u): u ∈ ℤd}, the recurrence time Rn(x) may be defined as the smallest positive k, such that the pattern {x(u): 0 ≤ ui < n} is seen again, in a new position in the cube {0 ≤ |ui| < k}. In analogy with the case of d = 1, where the pioneering work was done by Wyner and Ziv, we prove here that the asymptotic growth of Rn(x) for ergodic fields is given by the entropy of the random field. The nonergodic case is also treated, as well as the recurrence times of central patterns in centered cubes. Both finite and countable state spaces are treated.

Original languageEnglish
Pages (from-to)1694-1697
Number of pages4
JournalIEEE Transactions on Information Theory
Volume48
Issue number6
DOIs
StatePublished - Jun 2002

Keywords

  • Countable alphabet
  • Entropy
  • Random fields
  • Recurrence times
  • Shannon-McMillan-Breiman (SMB) theorem

Fingerprint

Dive into the research topics of 'Entropy and recurrence rates for stationary random fields'. Together they form a unique fingerprint.

Cite this