Single-letter bounds on the feedback capacity of unifilar finite-state channels

Oron Sabag, Haim H. Permuter, Henry D. Pfister

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Upper and lower bounds on the feedback capacity of unifilar finite-state channels (FSCs) are derived. The upper bound is derived using a new technique, called the Q-contexts, which is based on a construction of a directed graph that is used to quantize recursively the receiver's output sequences to a finite set of contexts. For any choice of Q-graph, the feedback capacity is bounded by a single-letter expression, Cfb ≤ sup I (X, S; Y |Q), where the supremum is over Px|s,q and the distribution of (S, Q) is their stationary distribution. The bound is tight for all unifilar FSCs where feedback capacity is known: channels where the state is a function of the outputs, the trapdoor channel, Ising channels, the no-consecutive-ones input-constrained erasure channel and for the memoryless channel. The upper bound indicates that a single-letter expression might exist for the capacity of finite-state channels with or without feedback which are based on a construction of auxiliary random variable with memory, such as Q-graph, and not with i.i.d distribution. The lower bound provides a sufficient condition for the optimality of the upper bound, however, it is formulated such that independent lower bounds on feedback capacity may be calculated. The efficiency of these bounds is demonstrated by deriving a new capacity result for the dicode erasure channel (DEC). The upper bound also serves as a non-trivial bound on the capacity of channels without feedback, a problem that is still open.

Original languageAmerican English
Title of host publication2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509021529
DOIs
StatePublished - 4 Jan 2017
Externally publishedYes
Event2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016 - Eilat, Israel
Duration: 16 Nov 201618 Nov 2016

Publication series

Name2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016

Conference

Conference2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016
Country/TerritoryIsrael
CityEilat
Period16/11/1618/11/16

Bibliographical note

Publisher Copyright:
© 2016 IEEE.

Fingerprint

Dive into the research topics of 'Single-letter bounds on the feedback capacity of unifilar finite-state channels'. Together they form a unique fingerprint.

Cite this