About cookies on this site Our websites require some cookies to function properly (required). In addition, other cookies may be used with your consent to analyze site usage, improve the user experience and for advertising. For more information, please review your options. By visiting our website, you agree to our processing of information as described in IBM’sprivacy statement. To provide a smooth navigation, your cookie preferences will be shared across the IBM web domains listed here.
Publication
IEEE Trans. Inf. Theory
Paper
Renyi's Entropy and the Probability of Error
Abstract
The basic properties of Renyi's entropy are reviewed, and its concavity properties are characterized. New bounds (referred to as Iα bounds) on the probability of error are derived from Renyi's entropy and are compared with known bounds. It is proved that for the two-class case, the I2 bound is sharper than many of the previously known bounds. The difference between the I2 bound and the real value of the probability of error is at most 0.09. © 1978 IEEE