Mismatched codebooks and the role of entropy-coding in lossy data compression

Ioannis Kontoyiannis; Ram Zamir

doi:10.1109/isit.2003.1228181

Mismatched codebooks and the role of entropy-coding in lossy data compression

Ioannis Kontoyiannis^*, Ram Zamir

^*Corresponding author for this work

Engineering General

Brown University

Research output: Contribution to journal › Conference article › peer-review

Abstract

We develop a random coding model for universal quantization. The universal quantizer consists of a (typically) mismatched random codebook followed by optimal entropy-coding. We precisely characterize the rate gain due to entropy-coding and show that it may be arbitrarily large. In the special case of entropy-coded i.i.d. Gaussian codebooks with large variance, we draw a novel connection with the compression performance of entropy-coded dithered lattice quantization. Our main tools are large deviations techniques that allow us to prove an almost sure version of the conditional limit theorem.

Original language	English
Pages (from-to)	167
Number of pages	1
Journal	IEEE International Symposium on Information Theory - Proceedings
DOIs	https://doi.org/10.1109/isit.2003.1228181
State	Published - 2003
Event	Proceedings 2003 IEEE International Symposium on Information Theory (ISIT) - Yokohama, Japan Duration: 29 Jun 2003 → 4 Jul 2003

Funding

Funders	Funder number
National Science Foundation	0073378

Access to Document

10.1109/isit.2003.1228181

Cite this

@article{b636a79a730b401fbe97b55e41dff41f,

title = "Mismatched codebooks and the role of entropy-coding in lossy data compression",

abstract = "We develop a random coding model for universal quantization. The universal quantizer consists of a (typically) mismatched random codebook followed by optimal entropy-coding. We precisely characterize the rate gain due to entropy-coding and show that it may be arbitrarily large. In the special case of entropy-coded i.i.d. Gaussian codebooks with large variance, we draw a novel connection with the compression performance of entropy-coded dithered lattice quantization. Our main tools are large deviations techniques that allow us to prove an almost sure version of the conditional limit theorem.",

author = "Ioannis Kontoyiannis and Ram Zamir",

year = "2003",

doi = "10.1109/isit.2003.1228181",

language = "אנגלית",

pages = "167",

journal = "IEEE International Symposium on Information Theory - Proceedings",

issn = "2157-8096",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

note = "Proceedings 2003 IEEE International Symposium on Information Theory (ISIT) ; Conference date: 29-06-2003 Through 04-07-2003",

}

TY - JOUR

T1 - Mismatched codebooks and the role of entropy-coding in lossy data compression

AU - Kontoyiannis, Ioannis

AU - Zamir, Ram

PY - 2003

Y1 - 2003

N2 - We develop a random coding model for universal quantization. The universal quantizer consists of a (typically) mismatched random codebook followed by optimal entropy-coding. We precisely characterize the rate gain due to entropy-coding and show that it may be arbitrarily large. In the special case of entropy-coded i.i.d. Gaussian codebooks with large variance, we draw a novel connection with the compression performance of entropy-coded dithered lattice quantization. Our main tools are large deviations techniques that allow us to prove an almost sure version of the conditional limit theorem.

AB - We develop a random coding model for universal quantization. The universal quantizer consists of a (typically) mismatched random codebook followed by optimal entropy-coding. We precisely characterize the rate gain due to entropy-coding and show that it may be arbitrarily large. In the special case of entropy-coded i.i.d. Gaussian codebooks with large variance, we draw a novel connection with the compression performance of entropy-coded dithered lattice quantization. Our main tools are large deviations techniques that allow us to prove an almost sure version of the conditional limit theorem.

UR - http://www.scopus.com/inward/record.url?scp=0141973696&partnerID=8YFLogxK

U2 - 10.1109/isit.2003.1228181

DO - 10.1109/isit.2003.1228181

M3 - ???researchoutput.researchoutputtypes.contributiontojournal.conferencearticle???

AN - SCOPUS:0141973696

SN - 2157-8096

SP - 167

JO - IEEE International Symposium on Information Theory - Proceedings

JF - IEEE International Symposium on Information Theory - Proceedings

T2 - Proceedings 2003 IEEE International Symposium on Information Theory (ISIT)

Y2 - 29 June 2003 through 4 July 2003

ER -

Mismatched codebooks and the role of entropy-coding in lossy data compression

Abstract

Funding

Access to Document

Other files and links

Fingerprint

Cite this