HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Audio word similarity for clustering with zero resources based on iterative HMM classification

Amélie Royer 1 Guillaume Gravier 1 Vincent Claveau 1
1 LinkMedia - Creating and exploiting explicit links between multimedia fragments
Inria Rennes – Bretagne Atlantique , IRISA-D6 - MEDIA ET INTERACTIONS
Abstract : Recent work on zero resource word discovery makes intensive use of audio fragment clustering to find repeating speech patterns. In the absence of acoustic models, the clustering step traditionally relies on dynamic time warping (DTW) to compare two samples and thus suffers from the known limitations of this technique. We propose a new sample comparison method, called 'similarity by iterative classification', that exploits the modeling capacities of hidden Markov models (HMM) with no supervision. The core idea relies on the use of HMMs trained on randomly labeled data and exploits the fact that similar samples are more likely to be classified together by a large number of random classifiers than dissimilar ones. The resulting similarity measure is compared to DTW on two tasks, namely nearest neighbor retrieval and clustering , showing that the generalization capabilities of probabilis-tic machine learning significantly benefit to audio word comparison and overcome many of the limitations of DTW-based comparison.
Complete list of metadata

Cited literature [13 references]  Display  Hide  Download

Contributor : Vincent Claveau Connect in order to contact the contributor
Submitted on : Wednesday, November 9, 2016 - 5:01:34 PM
Last modification on : Wednesday, November 3, 2021 - 6:05:35 AM
Long-term archiving on: : Wednesday, March 15, 2017 - 4:25:31 AM


Files produced by the author(s)



Amélie Royer, Guillaume Gravier, Vincent Claveau. Audio word similarity for clustering with zero resources based on iterative HMM classification. International Conference on Acoustics, Speech and Signal Processing, ICASSP, Mar 2016, Shanghai, China. pp.5340 - 5344, ⟨10.1109/ICASSP.2016.7472697⟩. ⟨hal-01394757⟩



Record views


Files downloads