On the Information Geometry of Audio Streams with Applications to Similarity Computing

Arshia Cont (1, 2) , Shlomo Dubnov (3) , Gérard Assayag (4)

1 MuTant - Synchronous Realtime Processing and Programming of Music Signals
2 MuSync
3 UC San Diego - University of California [San Diego]
4 STMS - Sciences et Technologies de la Musique et du Son

This paper proposes methods for information processing of audio streams using methods of information geometry. We lay the theoretical groundwork for a framework allowing the treatment of signal information as information entities, suitable for similarity and symbolic computing on audio signals. The theoretical basis of this paper is based on the information geometry of statistical structures representing audio spectrum features, and specifically through the bijection between the generic families of Bregman divergences and that of exponential distributions. The proposed framework, called Music Information Geometry allows online segmentation of audio streams to metric balls where each ball represents a quasi-stationary continuous chunk of audio, and discusses methods to qualify and quantify information between entities for similarity computing. We define an information geometry that approximates a similarity metric space, redefine general notions in music information retrieval such as similarity between entities, and address methods for dealing with non-stationarity of audio signals. We demonstrate the framework on two sample applications for online audio structure discovery and audio matching.

Mots clés: Information Geometry; Music Signal Processing; Audio Content Analysis; Realtime Analysis

Domaines: Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]

Arshia Cont, Shlomo Dubnov, Gérard Assayag. On the Information Geometry of Audio Streams with Applications to Similarity Computing. IEEE Transactions on Audio, Speech and Language Processing, 2011, 19 (4), pp.837-846. ⟨10.1109/TASL.2010.2066266⟩. ⟨hal-00579590⟩