Audio word similarity for clustering with zero resources based on iterative HMM classification

Amélie Royer 1 Guillaume Gravier 1 Vincent Claveau 1
1 LinkMedia - Creating and exploiting explicit links between multimedia fragments
IRISA-D6 - MEDIA ET INTERACTIONS, Inria Rennes – Bretagne Atlantique
Abstract : Recent work on zero resource word discovery makes intensive use of audio fragment clustering to find repeating speech patterns. In the absence of acoustic models, the clustering step traditionally relies on dynamic time warping (DTW) to compare two samples and thus suffers from the known limitations of this technique. We propose a new sample comparison method, called 'similarity by iterative classification', that exploits the modeling capacities of hidden Markov models (HMM) with no supervision. The core idea relies on the use of HMMs trained on randomly labeled data and exploits the fact that similar samples are more likely to be classified together by a large number of random classifiers than dissimilar ones. The resulting similarity measure is compared to DTW on two tasks, namely nearest neighbor retrieval and clustering , showing that the generalization capabilities of probabilis-tic machine learning significantly benefit to audio word comparison and overcome many of the limitations of DTW-based comparison.
Liste complète des métadonnées

Cited literature [13 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01394757
Contributor : Vincent Claveau <>
Submitted on : Wednesday, November 9, 2016 - 5:01:34 PM
Last modification on : Thursday, February 7, 2019 - 3:47:25 PM
Document(s) archivé(s) le : Wednesday, March 15, 2017 - 4:25:31 AM

File

ICASSP2016.pdf
Files produced by the author(s)

Identifiers

Citation

Amélie Royer, Guillaume Gravier, Vincent Claveau. Audio word similarity for clustering with zero resources based on iterative HMM classification. International Conference on Acoustics, Speech and Signal Processing, ICASSP, Mar 2016, Shanghai, China. pp.5340 - 5344, ⟨10.1109/ICASSP.2016.7472697⟩. ⟨hal-01394757⟩

Share

Metrics

Record views

1149

Files downloads

323