A Lower Bound on the Expected Distortion of Joint Source-Channel Coding

Yuval Kochman; Or Ordentlich; Yury Polyanskiy

doi:10.1109/ISIT.2019.8849390

A Lower Bound on the Expected Distortion of Joint Source-Channel Coding

Yuval Kochman
, Or Ordentlich
, Yury Polyanskiy

The Rachel and Selim Benin School of Engineering and Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

7 Scopus citations

Abstract

We consider the classic joint source-channel coding problem of transmitting a memoryless source over a memoryless channel. The focus of this work is on the rate of convergence of the smallest attainable expected distortion to its asymptotic value, as a function of blocklength n. Our main result is that in general the convergence rate is not faster than n^-1/2. In particular, we show that for the problem of transmitting i.i.d uniform bits over a binary symmetric channels with Hamming distortion, the smallest attainable distortion (bit error rate) is at least Ω(n^-1/2) above the asymptotic value, if the "bandwidth expansion ratio" is above 1.

Original language	English
Title of host publication	2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1332-1336
Number of pages	5
ISBN (Electronic)	9781538692912
DOIs	https://doi.org/10.1109/ISIT.2019.8849390
State	Published - Jul 2019
Event	2019 IEEE International Symposium on Information Theory, ISIT 2019 - Paris, France Duration: 7 Jul 2019 → 12 Jul 2019

Publication series

Name	IEEE International Symposium on Information Theory - Proceedings
Volume	2019-July
ISSN (Electronic)	2157-8117

Conference

Conference	2019 IEEE International Symposium on Information Theory, ISIT 2019
Country/Territory	France
City	Paris
Period	7/07/19 → 12/07/19

Bibliographical note

Publisher Copyright:
© 2019 IEEE.

Access to Document

10.1109/ISIT.2019.8849390

Cite this

Kochman, Y., Ordentlich, O., & Polyanskiy, Y. (2019). A Lower Bound on the Expected Distortion of Joint Source-Channel Coding. In 2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings (pp. 1332-1336). Article 8849390 (IEEE International Symposium on Information Theory - Proceedings; Vol. 2019-July). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISIT.2019.8849390

@inproceedings{401d063612724c409bfa3fc62bdd78ab,

title = "A Lower Bound on the Expected Distortion of Joint Source-Channel Coding",

abstract = "We consider the classic joint source-channel coding problem of transmitting a memoryless source over a memoryless channel. The focus of this work is on the rate of convergence of the smallest attainable expected distortion to its asymptotic value, as a function of blocklength n. Our main result is that in general the convergence rate is not faster than n-1/2. In particular, we show that for the problem of transmitting i.i.d uniform bits over a binary symmetric channels with Hamming distortion, the smallest attainable distortion (bit error rate) is at least Ω(n-1/2) above the asymptotic value, if the {"}bandwidth expansion ratio{"} is above 1.",

author = "Yuval Kochman and Or Ordentlich and Yury Polyanskiy",

note = "Publisher Copyright: {\textcopyright} 2019 IEEE.; 2019 IEEE International Symposium on Information Theory, ISIT 2019 ; Conference date: 07-07-2019 Through 12-07-2019",

year = "2019",

month = jul,

doi = "10.1109/ISIT.2019.8849390",

language = "אנגלית",

series = "IEEE International Symposium on Information Theory - Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "1332--1336",

booktitle = "2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings",

address = "ארצות הברית",

}

Kochman, Y , Ordentlich, O & Polyanskiy, Y 2019, A Lower Bound on the Expected Distortion of Joint Source-Channel Coding. in 2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings., 8849390, IEEE International Symposium on Information Theory - Proceedings, vol. 2019-July, Institute of Electrical and Electronics Engineers Inc., pp. 1332-1336, 2019 IEEE International Symposium on Information Theory, ISIT 2019, Paris, France, 7/07/19. https://doi.org/10.1109/ISIT.2019.8849390

A Lower Bound on the Expected Distortion of Joint Source-Channel Coding. / Kochman, Yuval ; Ordentlich, Or; Polyanskiy, Yury.
2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. p. 1332-1336 8849390 (IEEE International Symposium on Information Theory - Proceedings; Vol. 2019-July).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A Lower Bound on the Expected Distortion of Joint Source-Channel Coding

AU - Kochman, Yuval

AU - Ordentlich, Or

AU - Polyanskiy, Yury

PY - 2019/7

Y1 - 2019/7

N2 - We consider the classic joint source-channel coding problem of transmitting a memoryless source over a memoryless channel. The focus of this work is on the rate of convergence of the smallest attainable expected distortion to its asymptotic value, as a function of blocklength n. Our main result is that in general the convergence rate is not faster than n-1/2. In particular, we show that for the problem of transmitting i.i.d uniform bits over a binary symmetric channels with Hamming distortion, the smallest attainable distortion (bit error rate) is at least Ω(n-1/2) above the asymptotic value, if the "bandwidth expansion ratio" is above 1.

AB - We consider the classic joint source-channel coding problem of transmitting a memoryless source over a memoryless channel. The focus of this work is on the rate of convergence of the smallest attainable expected distortion to its asymptotic value, as a function of blocklength n. Our main result is that in general the convergence rate is not faster than n-1/2. In particular, we show that for the problem of transmitting i.i.d uniform bits over a binary symmetric channels with Hamming distortion, the smallest attainable distortion (bit error rate) is at least Ω(n-1/2) above the asymptotic value, if the "bandwidth expansion ratio" is above 1.

UR - https://www.scopus.com/pages/publications/85073169379

U2 - 10.1109/ISIT.2019.8849390

DO - 10.1109/ISIT.2019.8849390

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:85073169379

T3 - IEEE International Symposium on Information Theory - Proceedings

SP - 1332

EP - 1336

BT - 2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2019 IEEE International Symposium on Information Theory, ISIT 2019

Y2 - 7 July 2019 through 12 July 2019

ER -

Kochman Y , Ordentlich O, Polyanskiy Y. A Lower Bound on the Expected Distortion of Joint Source-Channel Coding. In 2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2019. p. 1332-1336. 8849390. (IEEE International Symposium on Information Theory - Proceedings). doi: 10.1109/ISIT.2019.8849390

A Lower Bound on the Expected Distortion of Joint Source-Channel Coding

Abstract

Publication series

Conference

Bibliographical note

Access to Document

Other files and links

Fingerprint