Deep convolutional transformer network for hyperspectral unmixing
ABSTRACTHyperspectral unmixing (HU) is considered one of the most important ways to improve hyperspectral image analysis. HU aims to break down the mixed pixel into a set of spectral signatures, often commonly referred to as endmembers, and determine the fractional abundance of those endmembers. Dee...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Taylor & Francis Group
2023-12-01
|
| Series: | European Journal of Remote Sensing |
| Subjects: | |
| Online Access: | https://www.tandfonline.com/doi/10.1080/22797254.2023.2268820 |
| _version_ | 1797645601927593984 |
|---|---|
| author | Fazal Hadi Jingxiang Yang Ghulam Farooque Liang Xiao |
| author_facet | Fazal Hadi Jingxiang Yang Ghulam Farooque Liang Xiao |
| author_sort | Fazal Hadi |
| collection | DOAJ |
| description | ABSTRACTHyperspectral unmixing (HU) is considered one of the most important ways to improve hyperspectral image analysis. HU aims to break down the mixed pixel into a set of spectral signatures, often commonly referred to as endmembers, and determine the fractional abundance of those endmembers. Deep learning (DL) approaches have recently received great attention regarding HU. In particular, convolutional neural networks (CNNs)-based methods have performed exceptionally well in such tasks. However, the ability of CNNs to learn deep semantic features is limited, and computing cost increase dramatically with the number of layers. The appearance of the transformer addresses these issues by effectively representing high-level semantic features well. In this article, we present a novel approach for HU that utilizes a deep convolutional transformer network. Firstly, the CNN-based autoencoder (AE) is used to extract low-level features from the input image. Secondly, the concept of tokenizer is applied for feature transformation. Thirdly, the transformer module is used to capture the deep semantic features derived from the tokenizer. Finally, a convolutional decoder is utilized to reconstruct the input image. The experimental results on synthetic and real datasets demonstrate the effectiveness and superiority of the proposed method compared with other unmixing methods. |
| first_indexed | 2024-03-11T14:49:11Z |
| format | Article |
| id | doaj.art-d443f8c48c2840bc94f024040c47b565 |
| institution | Directory Open Access Journal |
| issn | 2279-7254 |
| language | English |
| last_indexed | 2024-03-11T14:49:11Z |
| publishDate | 2023-12-01 |
| publisher | Taylor & Francis Group |
| record_format | Article |
| series | European Journal of Remote Sensing |
| spelling | doaj.art-d443f8c48c2840bc94f024040c47b5652023-10-30T10:22:48ZengTaylor & Francis GroupEuropean Journal of Remote Sensing2279-72542023-12-0156110.1080/22797254.2023.2268820Deep convolutional transformer network for hyperspectral unmixingFazal Hadi0Jingxiang Yang1Ghulam Farooque2Liang Xiao3School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, Jiangsu, ChinaSchool of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, Jiangsu, ChinaSchool of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, Jiangsu, ChinaSchool of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, Jiangsu, ChinaABSTRACTHyperspectral unmixing (HU) is considered one of the most important ways to improve hyperspectral image analysis. HU aims to break down the mixed pixel into a set of spectral signatures, often commonly referred to as endmembers, and determine the fractional abundance of those endmembers. Deep learning (DL) approaches have recently received great attention regarding HU. In particular, convolutional neural networks (CNNs)-based methods have performed exceptionally well in such tasks. However, the ability of CNNs to learn deep semantic features is limited, and computing cost increase dramatically with the number of layers. The appearance of the transformer addresses these issues by effectively representing high-level semantic features well. In this article, we present a novel approach for HU that utilizes a deep convolutional transformer network. Firstly, the CNN-based autoencoder (AE) is used to extract low-level features from the input image. Secondly, the concept of tokenizer is applied for feature transformation. Thirdly, the transformer module is used to capture the deep semantic features derived from the tokenizer. Finally, a convolutional decoder is utilized to reconstruct the input image. The experimental results on synthetic and real datasets demonstrate the effectiveness and superiority of the proposed method compared with other unmixing methods.https://www.tandfonline.com/doi/10.1080/22797254.2023.2268820Hyperspectral unmixingdeep learning (DL)transformerautoencoder (AE)tokenizerremote sensing |
| spellingShingle | Fazal Hadi Jingxiang Yang Ghulam Farooque Liang Xiao Deep convolutional transformer network for hyperspectral unmixing European Journal of Remote Sensing Hyperspectral unmixing deep learning (DL) transformer autoencoder (AE) tokenizer remote sensing |
| title | Deep convolutional transformer network for hyperspectral unmixing |
| title_full | Deep convolutional transformer network for hyperspectral unmixing |
| title_fullStr | Deep convolutional transformer network for hyperspectral unmixing |
| title_full_unstemmed | Deep convolutional transformer network for hyperspectral unmixing |
| title_short | Deep convolutional transformer network for hyperspectral unmixing |
| title_sort | deep convolutional transformer network for hyperspectral unmixing |
| topic | Hyperspectral unmixing deep learning (DL) transformer autoencoder (AE) tokenizer remote sensing |
| url | https://www.tandfonline.com/doi/10.1080/22797254.2023.2268820 |
| work_keys_str_mv | AT fazalhadi deepconvolutionaltransformernetworkforhyperspectralunmixing AT jingxiangyang deepconvolutionaltransformernetworkforhyperspectralunmixing AT ghulamfarooque deepconvolutionaltransformernetworkforhyperspectralunmixing AT liangxiao deepconvolutionaltransformernetworkforhyperspectralunmixing |