Asynchronous Distributed Matrix Factorization with Similar User and Item Based Regularization

Abstract : We introduce an asynchronous distributed stochastic gradient algorithm for matrix factorization based collaborative filtering. The main idea of this approach is to distribute the user-rating matrix across different machines, each having access only to a part of the information, and to asynchronously propagate the updates of the stochastic gradient optimization across the network. Each time a machine receives a parameter vector, it averages its current parameter vector with the received one, and continues its iterations from this new point. Additionally, we introduce a similarity based regularization that constrains the user and item factors to be close to the average factors of their similar users and items found on subparts of the distributed user-rating matrix. We analyze the impact of the regularization terms on MovieLens (100K, 1M, 10M) and NetFlix datasets and show that it leads to a more efficient matrix factorization in terms of Root Mean Square Error (RMSE) and Mean Absolute Error (MAE), and that the asynchronous distributed approach significantly improves in convergence time as compared to an equivalent synchronous distributed approach.
Type de document :
Communication dans un congrès
10th ACM Conference on Recommender Systems (RecSys '16), Sep 2016, Boston, United States. 2016, <https://recsys.acm.org/recsys16/>
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01406565
Contributeur : Massih-Reza Amini <>
Soumis le : jeudi 1 décembre 2016 - 12:32:29
Dernière modification le : mercredi 7 décembre 2016 - 11:10:07

Identifiants

  • HAL Id : hal-01406565, version 1

Collections

Citation

Bikash Joshi, Franck Iutzeler, Massih-Reza Amini. Asynchronous Distributed Matrix Factorization with Similar User and Item Based Regularization. 10th ACM Conference on Recommender Systems (RecSys '16), Sep 2016, Boston, United States. 2016, <https://recsys.acm.org/recsys16/>. <hal-01406565>

Partager

Métriques

Consultations de la notice

153