Rigorous optimisation of multilinear discriminant analysis with Tucker and PARAFAC structures
Abstract Background We propose rigorously optimised supervised feature extraction methods for multilinear data based on Multilinear Discriminant Analysis (MDA) and demonstrate their usage on Electroencephalography (EEG) and simulated data. While existing MDA methods use heuristic optimisation proced...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2018-05-01
|
| Series: | BMC Bioinformatics |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s12859-018-2188-0 |
| _version_ | 1818195775906119680 |
|---|---|
| author | Laura Frølich Tobias Søren Andersen Morten Mørup |
| author_facet | Laura Frølich Tobias Søren Andersen Morten Mørup |
| author_sort | Laura Frølich |
| collection | DOAJ |
| description | Abstract Background We propose rigorously optimised supervised feature extraction methods for multilinear data based on Multilinear Discriminant Analysis (MDA) and demonstrate their usage on Electroencephalography (EEG) and simulated data. While existing MDA methods use heuristic optimisation procedures based on an ambiguous Tucker structure, we propose a rigorous approach via optimisation on the cross-product of Stiefel manifolds. We also introduce MDA methods with the PARAFAC structure. We compare the proposed approaches to existing MDA methods and unsupervised multilinear decompositions. Results We find that manifold optimisation substantially improves MDA objective functions relative to existing methods and on simulated data in general improve classification performance. However, we find similar classification performance when applied to the electroencephalography data. Furthermore, supervised approaches substantially outperform unsupervised mulitilinear methods whereas methods with the PARAFAC structure perform similarly to those with Tucker structures. Notably, despite applying the MDA procedures to raw Brain-Computer Interface data, their performances are on par with results employing ample pre-processing and they extract discriminatory patterns similar to the brain activity known to be elicited in the investigated EEG paradigms. Conclusion The proposed usage of manifold optimisation constitutes the first rigorous and monotonous optimisation approach for MDA methods and allows for MDA with the PARAFAC structure. Our results show that MDA methods applied to raw EEG data can extract discriminatory patterns when compared to traditional unsupervised multilinear feature extraction approaches, whereas the proposed PARAFAC structured MDA models provide meaningful patterns of activity. |
| first_indexed | 2024-12-12T01:23:33Z |
| format | Article |
| id | doaj.art-2ea4d3f95a294a2c8d91113393f9fb27 |
| institution | Directory Open Access Journal |
| issn | 1471-2105 |
| language | English |
| last_indexed | 2024-12-12T01:23:33Z |
| publishDate | 2018-05-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Bioinformatics |
| spelling | doaj.art-2ea4d3f95a294a2c8d91113393f9fb272022-12-22T00:43:10ZengBMCBMC Bioinformatics1471-21052018-05-0119111510.1186/s12859-018-2188-0Rigorous optimisation of multilinear discriminant analysis with Tucker and PARAFAC structuresLaura Frølich0Tobias Søren Andersen1Morten Mørup2Department of Applied Mathematics and Computer Science, Technical University of DenmarkDepartment of Applied Mathematics and Computer Science, Technical University of DenmarkDepartment of Applied Mathematics and Computer Science, Technical University of DenmarkAbstract Background We propose rigorously optimised supervised feature extraction methods for multilinear data based on Multilinear Discriminant Analysis (MDA) and demonstrate their usage on Electroencephalography (EEG) and simulated data. While existing MDA methods use heuristic optimisation procedures based on an ambiguous Tucker structure, we propose a rigorous approach via optimisation on the cross-product of Stiefel manifolds. We also introduce MDA methods with the PARAFAC structure. We compare the proposed approaches to existing MDA methods and unsupervised multilinear decompositions. Results We find that manifold optimisation substantially improves MDA objective functions relative to existing methods and on simulated data in general improve classification performance. However, we find similar classification performance when applied to the electroencephalography data. Furthermore, supervised approaches substantially outperform unsupervised mulitilinear methods whereas methods with the PARAFAC structure perform similarly to those with Tucker structures. Notably, despite applying the MDA procedures to raw Brain-Computer Interface data, their performances are on par with results employing ample pre-processing and they extract discriminatory patterns similar to the brain activity known to be elicited in the investigated EEG paradigms. Conclusion The proposed usage of manifold optimisation constitutes the first rigorous and monotonous optimisation approach for MDA methods and allows for MDA with the PARAFAC structure. Our results show that MDA methods applied to raw EEG data can extract discriminatory patterns when compared to traditional unsupervised multilinear feature extraction approaches, whereas the proposed PARAFAC structured MDA models provide meaningful patterns of activity.http://link.springer.com/article/10.1186/s12859-018-2188-0Multilinear discriminant analysisElectroencephalographyEEGTensorClassificationStiefel manifold |
| spellingShingle | Laura Frølich Tobias Søren Andersen Morten Mørup Rigorous optimisation of multilinear discriminant analysis with Tucker and PARAFAC structures BMC Bioinformatics Multilinear discriminant analysis Electroencephalography EEG Tensor Classification Stiefel manifold |
| title | Rigorous optimisation of multilinear discriminant analysis with Tucker and PARAFAC structures |
| title_full | Rigorous optimisation of multilinear discriminant analysis with Tucker and PARAFAC structures |
| title_fullStr | Rigorous optimisation of multilinear discriminant analysis with Tucker and PARAFAC structures |
| title_full_unstemmed | Rigorous optimisation of multilinear discriminant analysis with Tucker and PARAFAC structures |
| title_short | Rigorous optimisation of multilinear discriminant analysis with Tucker and PARAFAC structures |
| title_sort | rigorous optimisation of multilinear discriminant analysis with tucker and parafac structures |
| topic | Multilinear discriminant analysis Electroencephalography EEG Tensor Classification Stiefel manifold |
| url | http://link.springer.com/article/10.1186/s12859-018-2188-0 |
| work_keys_str_mv | AT laurafrølich rigorousoptimisationofmultilineardiscriminantanalysiswithtuckerandparafacstructures AT tobiassørenandersen rigorousoptimisationofmultilineardiscriminantanalysiswithtuckerandparafacstructures AT mortenmørup rigorousoptimisationofmultilineardiscriminantanalysiswithtuckerandparafacstructures |