Information theoretic model for adaptive lossy compression

Ram Zamir, Kenneth Rose

Research output: Contribution to conferencePaperpeer-review

Abstract

We investigate the underlying mechanism of universal sequential, fixed distortion, lossy source coding algorithms, through the 'eyes' of a random code. We model the adaptive codebook as a 'mixed type' random code, whose codeword type distribution evolves with time while its dimension goes to infinity. The evolution law in our model has a structure of a tree; a type inherits its frequency in the code from its parent-types matching probabilities. We find that this mechanism naturally selects the 'good' codeword types for compressing the (unknown) source. As a consequence, the code becomes optimal for the source, and approaches the rate-distortion function as the time, and hence the dimension, go to infinity. Beyond its analytical interest, this model also provides guidelines for developing lossy string matching ('Lempel-Ziv-like') algorithms.

Original languageEnglish
Pages316-318
Number of pages3
StatePublished - 1996
EventProceedings of the 1996 19th Convention of Electrical and Electronics Engineers in Israel - Jerusalem, Isr
Duration: 5 Nov 19966 Nov 1996

Conference

ConferenceProceedings of the 1996 19th Convention of Electrical and Electronics Engineers in Israel
CityJerusalem, Isr
Period5/11/966/11/96

Cite this