15788 articles – 31778 references  [version française]
HAL: hal-00696072, version 1

Detailed view  Export this paper
20-th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN 2012), Bruges : Belgique (2012)
A Discussion on Parallelization Schemes for Stochastic Vector Quantization Algorithms
Matthieu Durut 1, 2, Benoît Patra 2, 3, Fabrice Rossi ( ) 4
(2012-04)

This paper studies parallelization schemes for stochastic Vector Quantization algorithms in order to obtain time speed-ups using distributed resources. We show that the most intuitive parallelization scheme does not lead to better performances than the sequential algorithm. Another distributed scheme is therefore introduced which obtains the expected speed-ups. Then, it is improved to fit implementation on distributed architectures where communications are slow and inter-machines synchronization too costly. The schemes are tested with simulated distributed architectures and, for the last one, with Microsoft Windows Azure platform obtaining speed-ups up to $32$ Virtual Machines.
1:  Laboratoire Traitement et Communication de l'Information [Paris] (LTCI)
Télécom ParisTech – CNRS : UMR5141
2:  Lokad
Lokad
3:  Laboratoire de Statistique Théorique et Appliquée (LSTA)
Université Pierre et Marie Curie [UPMC] - Paris VI
4:  Statistique, Analyse et Modélisation Multidisciplinaire (SAmos-Marin Mersenne) (SAMM)
Université Paris I - Panthéon-Sorbonne
Statistics/Machine Learning

Computer Science/Learning

Computer Science/Distributed, Parallel, and Cluster Computing
Attached file list to this document: 
ANNEX
spotlight-slide.pdf(27.6 KB)
poster.pdf(351.3 KB)
PDF
ESANN_DAVQ_Last.pdf(408.7 KB)