Linear local tangent space alignment with autoencoder

Abstract Linear local tangent space alignment (LLTSA) is a classical dimensionality reduction method based on manifold. However, LLTSA and all its variants only consider the one-way mapping from high-dimensional space to low-dimensional space. The projected low-dimensional data may not accurately an...

Full description

Bibliographic Details
Main Authors: Ruisheng Ran, Jinping Wang, Bin Fang
Format: Article
Language:English
Published: Springer 2023-04-01
Series:Complex & Intelligent Systems
Subjects:
Online Access:https://doi.org/10.1007/s40747-023-01055-x
_version_ 1797647154108432384
author Ruisheng Ran
Jinping Wang
Bin Fang
author_facet Ruisheng Ran
Jinping Wang
Bin Fang
author_sort Ruisheng Ran
collection DOAJ
description Abstract Linear local tangent space alignment (LLTSA) is a classical dimensionality reduction method based on manifold. However, LLTSA and all its variants only consider the one-way mapping from high-dimensional space to low-dimensional space. The projected low-dimensional data may not accurately and effectively “represent” the original samples. This paper proposes a novel LLTSA method based on the linear autoencoder called LLTSA-AE (LLTSA with Autoencoder). The proposed LLTSA-AE is divided into two stages. The conventional process of LLTSA is viewed as the encoding stage, and the additional and important decoding stage is used to reconstruct the original data. Thus, LLTSA-AE makes the low-dimensional embedding data “represent” the original data more accurately and effectively. LLTSA-AE gets the recognition rates of 85.10, 67.45, 75.40 and 86.67% on handwritten Alphadigits, FERET, Georgia Tech. and Yale datasets, which are 9.4, 14.03, 7.35 and 12.39% higher than that of the original LLTSA respectively. Compared with some improved methods of LLTSA, it also obtains better performance. For example, on Handwritten Alphadigits dataset, compared with ALLTSA, OLLTSA, PLLTSA and WLLTSA, the recognition rates of LLTSA-AE are improved by 4.77, 3.96, 7.8 and 8.6% respectively. It shows that LLTSA-AE is an effective dimensionality reduction method.
first_indexed 2024-03-11T15:12:15Z
format Article
id doaj.art-eb78fd6de01e4001ab56a34ddd277341
institution Directory Open Access Journal
issn 2199-4536
2198-6053
language English
last_indexed 2024-03-11T15:12:15Z
publishDate 2023-04-01
publisher Springer
record_format Article
series Complex & Intelligent Systems
spelling doaj.art-eb78fd6de01e4001ab56a34ddd2773412023-10-29T12:41:34ZengSpringerComplex & Intelligent Systems2199-45362198-60532023-04-01966255626810.1007/s40747-023-01055-xLinear local tangent space alignment with autoencoderRuisheng Ran0Jinping Wang1Bin Fang2The College of Computer and Information Science, College of Intelligent Science, Chongqing Normal UniversityThe College of Computer and Information Science, College of Intelligent Science, Chongqing Normal UniversityThe College of Computer Science, Chongqing UniversityAbstract Linear local tangent space alignment (LLTSA) is a classical dimensionality reduction method based on manifold. However, LLTSA and all its variants only consider the one-way mapping from high-dimensional space to low-dimensional space. The projected low-dimensional data may not accurately and effectively “represent” the original samples. This paper proposes a novel LLTSA method based on the linear autoencoder called LLTSA-AE (LLTSA with Autoencoder). The proposed LLTSA-AE is divided into two stages. The conventional process of LLTSA is viewed as the encoding stage, and the additional and important decoding stage is used to reconstruct the original data. Thus, LLTSA-AE makes the low-dimensional embedding data “represent” the original data more accurately and effectively. LLTSA-AE gets the recognition rates of 85.10, 67.45, 75.40 and 86.67% on handwritten Alphadigits, FERET, Georgia Tech. and Yale datasets, which are 9.4, 14.03, 7.35 and 12.39% higher than that of the original LLTSA respectively. Compared with some improved methods of LLTSA, it also obtains better performance. For example, on Handwritten Alphadigits dataset, compared with ALLTSA, OLLTSA, PLLTSA and WLLTSA, the recognition rates of LLTSA-AE are improved by 4.77, 3.96, 7.8 and 8.6% respectively. It shows that LLTSA-AE is an effective dimensionality reduction method.https://doi.org/10.1007/s40747-023-01055-xLinear local tangent space alignmentAutoencoderDimensionality reductionManifold learning
spellingShingle Ruisheng Ran
Jinping Wang
Bin Fang
Linear local tangent space alignment with autoencoder
Complex & Intelligent Systems
Linear local tangent space alignment
Autoencoder
Dimensionality reduction
Manifold learning
title Linear local tangent space alignment with autoencoder
title_full Linear local tangent space alignment with autoencoder
title_fullStr Linear local tangent space alignment with autoencoder
title_full_unstemmed Linear local tangent space alignment with autoencoder
title_short Linear local tangent space alignment with autoencoder
title_sort linear local tangent space alignment with autoencoder
topic Linear local tangent space alignment
Autoencoder
Dimensionality reduction
Manifold learning
url https://doi.org/10.1007/s40747-023-01055-x
work_keys_str_mv AT ruishengran linearlocaltangentspacealignmentwithautoencoder
AT jinpingwang linearlocaltangentspacealignmentwithautoencoder
AT binfang linearlocaltangentspacealignmentwithautoencoder