The idm Package: Incremental Decomposition Methods in R
In modern applications large amounts of data are produced at a high rate and are characterized by relationship structures changing over time. Principal component analysis (PCA) and multiple correspondence analysis (MCA) are well established dimension reduction methods to explore relationships within...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Foundation for Open Access Statistics
2018-09-01
|
| Series: | Journal of Statistical Software |
| Subjects: | |
| Online Access: | https://www.jstatsoft.org/index.php/jss/article/view/2632 |
| _version_ | 1828485878589161472 |
|---|---|
| author | Alfonso Iodice D'Enza Angelos Markos Davide Buttarazzi |
| author_facet | Alfonso Iodice D'Enza Angelos Markos Davide Buttarazzi |
| author_sort | Alfonso Iodice D'Enza |
| collection | DOAJ |
| description | In modern applications large amounts of data are produced at a high rate and are characterized by relationship structures changing over time. Principal component analysis (PCA) and multiple correspondence analysis (MCA) are well established dimension reduction methods to explore relationships within a set of variables. A critical step of the PCA and MCA algorithms is a singular value decomposition (SVD) or an eigenvalue decomposition (EVD) of a suitably transformed matrix. The high computational and memory requirements of ordinary SVD and EVD make their application impractical on massive or sequential data sets. A series of incremental SVD/EVD approaches are available to address these issues. The idm R package is introduced that implements two efficient incremental SVD approaches. The procedures in question share desirable properties that ease their embedding in PCA and MCA. The package also provides functions for producing animated visualizations of the obtained solutions. A comparison of online MCA implementations in terms of accuracy is also included. |
| first_indexed | 2024-12-11T09:21:55Z |
| format | Article |
| id | doaj.art-dc7716b32b7441099123d81abebd56f1 |
| institution | Directory Open Access Journal |
| issn | 1548-7660 |
| language | English |
| last_indexed | 2024-12-11T09:21:55Z |
| publishDate | 2018-09-01 |
| publisher | Foundation for Open Access Statistics |
| record_format | Article |
| series | Journal of Statistical Software |
| spelling | doaj.art-dc7716b32b7441099123d81abebd56f12022-12-22T01:13:14ZengFoundation for Open Access StatisticsJournal of Statistical Software1548-76602018-09-0186112410.18637/jss.v086.c041242The idm Package: Incremental Decomposition Methods in RAlfonso Iodice D'EnzaAngelos MarkosDavide ButtarazziIn modern applications large amounts of data are produced at a high rate and are characterized by relationship structures changing over time. Principal component analysis (PCA) and multiple correspondence analysis (MCA) are well established dimension reduction methods to explore relationships within a set of variables. A critical step of the PCA and MCA algorithms is a singular value decomposition (SVD) or an eigenvalue decomposition (EVD) of a suitably transformed matrix. The high computational and memory requirements of ordinary SVD and EVD make their application impractical on massive or sequential data sets. A series of incremental SVD/EVD approaches are available to address these issues. The idm R package is introduced that implements two efficient incremental SVD approaches. The procedures in question share desirable properties that ease their embedding in PCA and MCA. The package also provides functions for producing animated visualizations of the obtained solutions. A comparison of online MCA implementations in terms of accuracy is also included.https://www.jstatsoft.org/index.php/jss/article/view/2632singular value decompositiondimensionality reductionprincipal component analysiscorrespondence analysis |
| spellingShingle | Alfonso Iodice D'Enza Angelos Markos Davide Buttarazzi The idm Package: Incremental Decomposition Methods in R Journal of Statistical Software singular value decomposition dimensionality reduction principal component analysis correspondence analysis |
| title | The idm Package: Incremental Decomposition Methods in R |
| title_full | The idm Package: Incremental Decomposition Methods in R |
| title_fullStr | The idm Package: Incremental Decomposition Methods in R |
| title_full_unstemmed | The idm Package: Incremental Decomposition Methods in R |
| title_short | The idm Package: Incremental Decomposition Methods in R |
| title_sort | idm package incremental decomposition methods in r |
| topic | singular value decomposition dimensionality reduction principal component analysis correspondence analysis |
| url | https://www.jstatsoft.org/index.php/jss/article/view/2632 |
| work_keys_str_mv | AT alfonsoiodicedenza theidmpackageincrementaldecompositionmethodsinr AT angelosmarkos theidmpackageincrementaldecompositionmethodsinr AT davidebuttarazzi theidmpackageincrementaldecompositionmethodsinr AT alfonsoiodicedenza idmpackageincrementaldecompositionmethodsinr AT angelosmarkos idmpackageincrementaldecompositionmethodsinr AT davidebuttarazzi idmpackageincrementaldecompositionmethodsinr |