A note on bounded entropies

Abstract : The aim of the paper is to study the link between non-additivity of some entropies and their boundedness. We propose an axiomatic construction of the entropy relying on the fact that entropy belongs to a group isomorphic to the usual additive group. This allows to show that the entropies that are additive with respect to the addition of the group for independent random variables are nonlinear transforms of the Re?nyi entropies, including the particular case of the Shannon entropy. As a particular example, we study as a group a bounded interval in which the addition is a generalization of the addition of velocities in special relativity. We show that Tsallis–Havrda–Charvat entropy is included in the family of entropies we define. Finally, a link is made between the approach developed in the paper and the theory of deformed logarithms.

Contributeur : Pierre-Olivier Amblard <>
Soumis le : mardi 13 mars 2007 - 14:26:24
Dernière modification le : lundi 17 décembre 2007 - 11:41:26




Pierre-Olivier Amblard, Christophe Vignat. A note on bounded entropies. Physica A, Elsevier, 2006, 365, pp.50--56. <10.1016/j.physa.2006.01.002>. <hal-00136333>



Consultations de la notice