TY - JOUR

T1 - Non-asymptotic design of finite state universal predictors for individual sequences

AU - Ingber, Amir

AU - Feder, Meir

PY - 2006

Y1 - 2006

N2 - In this work we consider the problem of universal prediction of individual sequences where the universal predictor is a deterministic finite state machine, with a fixed, relatively small, number of states. We examine the case of self-information loss, where the predictions are probability assignments which is equivalent to universal data compression. While previous results in that area are asymptotic only, we examine a class of machine structures and find an optimal method for allocating the probabilities to the machine states which achieves minimal redundancy w.r.t. the constant predictors class. We show analytic bounds for the redundancy of machines from that class, and construct machines with redundancy that is arbitrarily close to these bounds. Finally, we compare our machines to previously proposed machines and show that our machine with 300 states achieves smaller redundancy than the best machine known so far with 6000 states.

AB - In this work we consider the problem of universal prediction of individual sequences where the universal predictor is a deterministic finite state machine, with a fixed, relatively small, number of states. We examine the case of self-information loss, where the predictions are probability assignments which is equivalent to universal data compression. While previous results in that area are asymptotic only, we examine a class of machine structures and find an optimal method for allocating the probabilities to the machine states which achieves minimal redundancy w.r.t. the constant predictors class. We show analytic bounds for the redundancy of machines from that class, and construct machines with redundancy that is arbitrarily close to these bounds. Finally, we compare our machines to previously proposed machines and show that our machine with 300 states achieves smaller redundancy than the best machine known so far with 6000 states.

UR - http://www.scopus.com/inward/record.url?scp=39049094768&partnerID=8YFLogxK

U2 - 10.1109/DCC.2006.54

DO - 10.1109/DCC.2006.54

M3 - ???researchoutput.researchoutputtypes.contributiontojournal.conferencearticle???

AN - SCOPUS:39049094768

SN - 1068-0314

SP - 3

EP - 12

JO - Proceedings of the Data Compression Conference

JF - Proceedings of the Data Compression Conference

M1 - 1607235

T2 - Data Compression Conference, DCC 2006

Y2 - 28 March 2006 through 30 March 2006

ER -