Matrix rigidity and the ill-posedness of robust PCA and matrix completion
<p style="text-align:justify;">Robust principal component analysis (RPCA) [J. Cand\`es et al., J. ACM, 58 (2011), pp. 1--37] and low-rank matrix completion [B. Recht, M. Fazel, and P. A. Parrilo, SIAM Rev., 52 (2010), pp. 471--501] are extensions of PCA that allow for outliers and mi...
| Main Authors: | , , |
|---|---|
| Format: | Journal article |
| Published: |
Society for Industrial and Applied Mathematics
2019
|
| _version_ | 1826306254871461888 |
|---|---|
| author | Tanner, J Andrew, T Vary, S |
| author_facet | Tanner, J Andrew, T Vary, S |
| author_sort | Tanner, J |
| collection | OXFORD |
| description | <p style="text-align:justify;">Robust principal component analysis (RPCA) [J. Cand\`es et al., J. ACM, 58 (2011), pp. 1--37] and low-rank matrix completion [B. Recht, M. Fazel, and P. A. Parrilo, SIAM Rev., 52 (2010), pp. 471--501] are extensions of PCA that allow for outliers and missing entries, respectively. It is well known that solving these problems requires a low coherence between the low-rank matrix and the canonical basis, since in the extreme cases---when the low-rank matrix we wish to recover is also sparse--- there is an inherent ambiguity. However, in both problems the well-posedness issue is even more fundamental; in some cases, both RPCA and matrix completion can fail to have any solutions due to the set of low-rank plus sparse matrices not being closed, which in turn is equivalent to the notion of the matrix rigidity function not being lower semicontinuous [Kumar et al., Comput. Complex., 23 (2014), pp. 531--563]. By constructing infinite families of matrices, we derive bounds on the rank and sparsity such that the set of low-rank plus sparse matrices is not closed. We also demonstrate numerically that a wide range of nonconvex algorithms for both RPCA and matrix completion have diverging components when applied to our constructed matrices. This is analogous to the case of sets of higher order tensors not being closed under canonical polyadic (CP) tensor rank, rendering the best low-rank tensor approximation unsolvable [V. de Silva and L.-H. Lim, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1084--1127] and hence encouraging the use of multilinear tensor rank [L. De Lathauwer, B. De Moor, and J. Vandewalle, SIAM J. Matrix Anal. Appl., 21 (2000), pp. 1324--1342].</p> |
| first_indexed | 2024-03-07T06:45:10Z |
| format | Journal article |
| id | oxford-uuid:fa9f8038-99ea-4359-b9c8-e3f0720a2916 |
| institution | University of Oxford |
| last_indexed | 2024-03-07T06:45:10Z |
| publishDate | 2019 |
| publisher | Society for Industrial and Applied Mathematics |
| record_format | dspace |
| spelling | oxford-uuid:fa9f8038-99ea-4359-b9c8-e3f0720a29162022-03-27T13:07:24ZMatrix rigidity and the ill-posedness of robust PCA and matrix completionJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:fa9f8038-99ea-4359-b9c8-e3f0720a2916Symplectic Elements at OxfordSociety for Industrial and Applied Mathematics2019Tanner, JAndrew, TVary, S<p style="text-align:justify;">Robust principal component analysis (RPCA) [J. Cand\`es et al., J. ACM, 58 (2011), pp. 1--37] and low-rank matrix completion [B. Recht, M. Fazel, and P. A. Parrilo, SIAM Rev., 52 (2010), pp. 471--501] are extensions of PCA that allow for outliers and missing entries, respectively. It is well known that solving these problems requires a low coherence between the low-rank matrix and the canonical basis, since in the extreme cases---when the low-rank matrix we wish to recover is also sparse--- there is an inherent ambiguity. However, in both problems the well-posedness issue is even more fundamental; in some cases, both RPCA and matrix completion can fail to have any solutions due to the set of low-rank plus sparse matrices not being closed, which in turn is equivalent to the notion of the matrix rigidity function not being lower semicontinuous [Kumar et al., Comput. Complex., 23 (2014), pp. 531--563]. By constructing infinite families of matrices, we derive bounds on the rank and sparsity such that the set of low-rank plus sparse matrices is not closed. We also demonstrate numerically that a wide range of nonconvex algorithms for both RPCA and matrix completion have diverging components when applied to our constructed matrices. This is analogous to the case of sets of higher order tensors not being closed under canonical polyadic (CP) tensor rank, rendering the best low-rank tensor approximation unsolvable [V. de Silva and L.-H. Lim, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1084--1127] and hence encouraging the use of multilinear tensor rank [L. De Lathauwer, B. De Moor, and J. Vandewalle, SIAM J. Matrix Anal. Appl., 21 (2000), pp. 1324--1342].</p> |
| spellingShingle | Tanner, J Andrew, T Vary, S Matrix rigidity and the ill-posedness of robust PCA and matrix completion |
| title | Matrix rigidity and the ill-posedness of robust PCA and matrix completion |
| title_full | Matrix rigidity and the ill-posedness of robust PCA and matrix completion |
| title_fullStr | Matrix rigidity and the ill-posedness of robust PCA and matrix completion |
| title_full_unstemmed | Matrix rigidity and the ill-posedness of robust PCA and matrix completion |
| title_short | Matrix rigidity and the ill-posedness of robust PCA and matrix completion |
| title_sort | matrix rigidity and the ill posedness of robust pca and matrix completion |
| work_keys_str_mv | AT tannerj matrixrigidityandtheillposednessofrobustpcaandmatrixcompletion AT andrewt matrixrigidityandtheillposednessofrobustpcaandmatrixcompletion AT varys matrixrigidityandtheillposednessofrobustpcaandmatrixcompletion |