Renyi's Entropy and the Probability of Error

Moshe Ben-Bassat; Josef Raviv

doi:10.1109/TIT.1978.1055890

Renyi's Entropy and the Probability of Error

Moshe Ben-Bassat, Josef Raviv

Research output: Contribution to journal › Article › peer-review

78 Scopus citations

Abstract

The basic properties of Renyi's entropy are reviewed, and its concavity properties are characterized. New bounds (referred to as I_α bounds) on the probability of error are derived from Renyi's entropy and are compared with known bounds. It is proved that for the two-class case, the I₂ bound is sharper than many of the previously known bounds. The difference between the I₂ bound and the real value of the probability of error is at most 0.09.

Original language	English
Pages (from-to)	324-331
Number of pages	8
Journal	IEEE Transactions on Information Theory
Volume	24
Issue number	3
DOIs	https://doi.org/10.1109/TIT.1978.1055890
State	Published - May 1978
Externally published	Yes

Access to Document

10.1109/TIT.1978.1055890

Cite this

@article{64a5f6de069a41b0846885733576e258,

title = "Renyi's Entropy and the Probability of Error",

abstract = "The basic properties of Renyi's entropy are reviewed, and its concavity properties are characterized. New bounds (referred to as Iα bounds) on the probability of error are derived from Renyi's entropy and are compared with known bounds. It is proved that for the two-class case, the I2 bound is sharper than many of the previously known bounds. The difference between the I2 bound and the real value of the probability of error is at most 0.09.",

author = "Moshe Ben-Bassat and Josef Raviv",

year = "1978",

month = may,

doi = "10.1109/TIT.1978.1055890",

language = "אנגלית",

volume = "24",

pages = "324--331",

journal = "IEEE Transactions on Information Theory",

issn = "0018-9448",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

number = "3",

}

TY - JOUR

T1 - Renyi's Entropy and the Probability of Error

AU - Ben-Bassat, Moshe

AU - Raviv, Josef

PY - 1978/5

Y1 - 1978/5

N2 - The basic properties of Renyi's entropy are reviewed, and its concavity properties are characterized. New bounds (referred to as Iα bounds) on the probability of error are derived from Renyi's entropy and are compared with known bounds. It is proved that for the two-class case, the I2 bound is sharper than many of the previously known bounds. The difference between the I2 bound and the real value of the probability of error is at most 0.09.

AB - The basic properties of Renyi's entropy are reviewed, and its concavity properties are characterized. New bounds (referred to as Iα bounds) on the probability of error are derived from Renyi's entropy and are compared with known bounds. It is proved that for the two-class case, the I2 bound is sharper than many of the previously known bounds. The difference between the I2 bound and the real value of the probability of error is at most 0.09.

UR - http://www.scopus.com/inward/record.url?scp=0017969718&partnerID=8YFLogxK

U2 - 10.1109/TIT.1978.1055890

DO - 10.1109/TIT.1978.1055890

M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???

AN - SCOPUS:0017969718

SN - 0018-9448

VL - 24

SP - 324

EP - 331

JO - IEEE Transactions on Information Theory

JF - IEEE Transactions on Information Theory

IS - 3

ER -

Renyi's Entropy and the Probability of Error

Abstract

Access to Document

Other files and links

Fingerprint

Cite this