 |
Free and accessible knowledge |
Conference papers
Subsampled online matrix factorization with convergence guarantees
Abstract : We present a matrix factorization algorithm that scales to input matrices that are large in both dimensions (i.e., that contains more than 1TB of data). The algorithm streams the matrix columns while subsampling them, resulting in low complexity per iteration and reasonable memory footprint. In contrast to previous online matrix factorization methods, our approach relies on low-dimensional statistics from past iterates to control the extra variance introduced by subsampling. We present a convergence analysis that guarantees us to reach a stationary point of the problem. Large speed-ups can be obtained compared to previous online algorithms that do not perform subsampling, thanks to the feature redundancy that often exists in high-dimensional settings.
Cited literature [11 references]
https://hal.archives-ouvertes.fr/hal-01405058
Contributor : Arthur Mensch Connect in order to contact the contributor
Submitted on : Wednesday, November 30, 2016 - 7:54:22 PM
Last modification on : Saturday, January 29, 2022 - 3:08:03 AM
Long-term archiving on: : Monday, March 27, 2017 - 9:06:02 AM
Contributor : Arthur Mensch Connect in order to contact the contributor
Submitted on : Wednesday, November 30, 2016 - 7:54:22 PM
Last modification on : Saturday, January 29, 2022 - 3:08:03 AM
Long-term archiving on: : Monday, March 27, 2017 - 9:06:02 AM
Files
modl_opt.pdf
Files produced by the author(s)