HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Entropy for dynamical sources

Julien Clément 1 Loïck Lhote 1 Brigitte Vallée 1
1 Equipe AMACC - Laboratoire GREYC - UMR6072
GREYC - Groupe de Recherche en Informatique, Image et Instrumentation de Caen
Abstract : A quite general model of source that comes from dynamical systems theory is introduced. Within this model, basic problems of algorithmic information theory contexts are analysed. The main tool for the analysis is a (generalized) trans-fer operator, which can be viewed as a "generating" operator for "fundamental" probabilities. Its dominant spectral objects are related to important parameters of the source, such as the entropy rate, and play a central rôle in all the results. 1 Dynamical sources. In information theory contexts, data items are (infinite) words that are pro-duced by a common mechanism, called a source. Real-life sources are often complex objects. We introduce here a general framework of sources related to dynamical systems theory which can be viewed as a generalization of numer-ation systems. This model goes beyond the cases of memoryless and Markov chains, it can describe nonmarkovian processes, where the dependency on past history is unbounded, and as such, it attains a high level of generality. A probabilistic dynamical source is defined by five elements: (a) an alphabet Σ, finite or denumerable, (b) a topological partition of I := [0, 1] with disjoint open intervals (I m) m∈Σ , (c) an encoding mapping σ which is constant and equal to m on each I m , (d) a shift mapping T whose restriction to I m is a bijection of class C 2 from I m to J m := T (I m). The local inverse of T | Im is denoted by h m , (e) a real density f on interval I, and its associated distribution function F . The dynamical system S := (I, T), defined by the first four elements, asso-ciates to a real number x ∈ I the word M (x) := (σx, σT x, σT 2 x, .
Complete list of metadata

Cited literature [9 references]  Display  Hide  Download

Contributor : Greyc Référent Connect in order to contact the contributor
Submitted on : Wednesday, November 12, 2014 - 2:54:31 PM
Last modification on : Tuesday, October 19, 2021 - 11:34:56 PM
Long-term archiving on: : Friday, February 13, 2015 - 11:06:37 AM


Files produced by the author(s)


  • HAL Id : hal-01082045, version 1


Julien Clément, Loïck Lhote, Brigitte Vallée. Entropy for dynamical sources. Proceedings of IWAP 2008, Jul 2009, Compiègne, France. ⟨hal-01082045⟩



Record views


Files downloads