Efficient local search for L$_1$ and L$_2$ binary matrix factorization

Hamid Mirisaee (1, 2, 3) , Eric Gaussier (2, 3, 1) , Alexandre Termier (4, 5)

1 AMA - Analyse de données, Modélisation et Apprentissage automatique [Grenoble]
2 UGA [2016-2019] - Université Grenoble Alpes [2016-2019]
3 LIG - Laboratoire d'Informatique de Grenoble
4 UR - Université de Rennes
5 LACODAM - Large Scale Collaborative Data Mining

Rank K Binary Matrix Factorization (BMF) approximates a binary matrix by the product of two binary matrices of lower rank, K. Several researchers have addressed this problem, focusing on either approximations of rank 1 or higher, using either the L 1 or L 2-norms for measuring the quality of the approximation. The rank 1 problem (for which the L 1 and L 2-norms are equivalent) has been shown to be related to the Integer Linear Programming (ILP) problem. We first show here that the alternating strategy with the L 2-norm, at the core of several methods used to solve BMF, can be reformulated as an Unconstrained Binary Quadratic Programming (UBQP) problem. This reformulation allows us to use local search procedures designed for UBQP in order to improve the solutions of BMF. We then introduce a new local search dedicated to the BMF problem. We show in particular that this solution is in average faster than the previously proposed ones. We then assess its behavior on several collections and methods and show that it significantly improves methods targeting the L 2-norms on all the datasets considered; for the L 1-norm, the improvement is also significant for real, structured datasets and for the BMF problem without the binary reconstruction constraint.

Mots clés: Binary Matrix Factorization; Local Search; Heuristic

Domaines: Intelligence artificielle [cs.AI]; Base de données [cs.DB]

Hamid Mirisaee, Eric Gaussier, Alexandre Termier. Efficient local search for L$_1$ and L$_2$ binary matrix factorization. Intelligent Data Analysis, 2016, 20, pp.783 - 807. ⟨10.3233/IDA-160832⟩. ⟨hal-01405186⟩