On Low Rank Matrix Approximations with Applications to Synthesis Problem in Compressed Sensing

Anatoli B. Juditsky (1) , Fatma Kilinc Karzan (2) , Arkadii S. Nemirovski (2)

1 SAM - Statistique Apprentissage Machine
2 ISyE - School of Industrial and Systems Engineering [Georgia Tech]

We consider the synthesis problem}of Compressed Sensing - given s and an MXn matrix A, extract from it an mXn submatrix A', certified to be s-good, with m as small as possible. Starting from the verifiable sufficient conditions of s-goodness, we express the synthesis problem as the problem of approximating a given matrix by a matrix of specified low rank in the uniform norm. We propose randomized algorithms for efficient construction of rank k approximation of matrices of size mXn achieving accuracy bounds O(1)sqrt({ln(mn)/k) which hold in expectation or with high probability. We also supply derandomized versions of the approximation algorithms which does not require random sampling of matrices and attains the same accuracy bounds. We further demonstrate that our algorithms are optimal up to the logarithmic in m and n factor. We provide preliminary numerical results on the performance of our algorithms for the synthesis problem.

Mots clés: compressive sensing; low rank matrix approximations

Domaines: Optimisation et contrôle [math.OC]; Statistiques [math.ST]; Théorie [stat.TH]

Anatoli B. Juditsky, Fatma Kilinc Karzan, Arkadii S. Nemirovski. On Low Rank Matrix Approximations with Applications to Synthesis Problem in Compressed Sensing. SIAM Journal on Matrix Analysis and Applications, 2011, 32 (3), pp.1019-1029. ⟨10.1137/100792251⟩. ⟨hal-00450983v2⟩