Hyperspectral Classification Using Deep Belief Networks Based on Conjugate Gradient Update and Pixel-Centric Spectral Block Features
This article describes the use of deep belief networks (DBNs) based on the conjugate gradient (CG) update algorithm for hyperspectral classification. DBNs perform two processes: unsupervised pretraining and supervised fine-tuning. The parameter update method in the fine-tuning stage plays a key role...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2020-01-01
|
| Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9139188/ |
| _version_ | 1818890154833608704 |
|---|---|
| author | Chen Chen Yi Ma Guangbo Ren |
| author_facet | Chen Chen Yi Ma Guangbo Ren |
| author_sort | Chen Chen |
| collection | DOAJ |
| description | This article describes the use of deep belief networks (DBNs) based on the conjugate gradient (CG) update algorithm for hyperspectral classification. DBNs perform two processes: unsupervised pretraining and supervised fine-tuning. The parameter update method in the fine-tuning stage plays a key role in optimizing the classification model. The proposed method employs CG-based fine-tuning to avoid the “zig-zagging” problem with the gradient descent algorithm and to accelerate the DBN convergence. First, the spectral features and pixel-centric spectral block features are extracted from hyperspectral images for use as the input vectors. The update variables are then calculated based on a CG algorithm and the 2-norm, and the parameters are updated during the backpropagation step of the proposed CGDBN. Two models with different CG methods are applied to a public hyperspectral image benchmark for classification experiments and analysis, and the results are compared with those from several classification methods that are currently in use. The experimental results show that the proposed classification models have advantages in terms of model convergence and low sensitivity to certain parameters. In addition, application to a hyperspectral image of coastal wetlands in the Yellow River Delta produces a satisfactory classification. The results of this study demonstrate that the proposed CG-update-based DBN provides a new approach for hyperspectral dataset classification. |
| first_indexed | 2024-12-19T17:20:25Z |
| format | Article |
| id | doaj.art-d6c7142323734a7e899aaaf9d4d180ed |
| institution | Directory Open Access Journal |
| issn | 2151-1535 |
| language | English |
| last_indexed | 2024-12-19T17:20:25Z |
| publishDate | 2020-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| spelling | doaj.art-d6c7142323734a7e899aaaf9d4d180ed2022-12-21T20:12:42ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352020-01-01134060406910.1109/JSTARS.2020.30088259139188Hyperspectral Classification Using Deep Belief Networks Based on Conjugate Gradient Update and Pixel-Centric Spectral Block FeaturesChen Chen0https://orcid.org/0000-0001-6022-3482Yi Ma1https://orcid.org/0000-0002-5641-3766Guangbo Ren2College of Geomatics, Shandong University of Science and Technology, Qingdao, ChinaMarine Remote Sensing Division, First Institute of Oceanography, Ministry of Natural Resources, Qingdao, ChinaMarine Remote Sensing Division, First Institute of Oceanography, Ministry of Natural Resources, Qingdao, ChinaThis article describes the use of deep belief networks (DBNs) based on the conjugate gradient (CG) update algorithm for hyperspectral classification. DBNs perform two processes: unsupervised pretraining and supervised fine-tuning. The parameter update method in the fine-tuning stage plays a key role in optimizing the classification model. The proposed method employs CG-based fine-tuning to avoid the “zig-zagging” problem with the gradient descent algorithm and to accelerate the DBN convergence. First, the spectral features and pixel-centric spectral block features are extracted from hyperspectral images for use as the input vectors. The update variables are then calculated based on a CG algorithm and the 2-norm, and the parameters are updated during the backpropagation step of the proposed CGDBN. Two models with different CG methods are applied to a public hyperspectral image benchmark for classification experiments and analysis, and the results are compared with those from several classification methods that are currently in use. The experimental results show that the proposed classification models have advantages in terms of model convergence and low sensitivity to certain parameters. In addition, application to a hyperspectral image of coastal wetlands in the Yellow River Delta produces a satisfactory classification. The results of this study demonstrate that the proposed CG-update-based DBN provides a new approach for hyperspectral dataset classification.https://ieeexplore.ieee.org/document/9139188/Backpropagation (BP)conjugate gradient (CG)deep belief network (DBN)hyperspectral image classificationpixel-centric spectral block features2-norm |
| spellingShingle | Chen Chen Yi Ma Guangbo Ren Hyperspectral Classification Using Deep Belief Networks Based on Conjugate Gradient Update and Pixel-Centric Spectral Block Features IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Backpropagation (BP) conjugate gradient (CG) deep belief network (DBN) hyperspectral image classification pixel-centric spectral block features 2-norm |
| title | Hyperspectral Classification Using Deep Belief Networks Based on Conjugate Gradient Update and Pixel-Centric Spectral Block Features |
| title_full | Hyperspectral Classification Using Deep Belief Networks Based on Conjugate Gradient Update and Pixel-Centric Spectral Block Features |
| title_fullStr | Hyperspectral Classification Using Deep Belief Networks Based on Conjugate Gradient Update and Pixel-Centric Spectral Block Features |
| title_full_unstemmed | Hyperspectral Classification Using Deep Belief Networks Based on Conjugate Gradient Update and Pixel-Centric Spectral Block Features |
| title_short | Hyperspectral Classification Using Deep Belief Networks Based on Conjugate Gradient Update and Pixel-Centric Spectral Block Features |
| title_sort | hyperspectral classification using deep belief networks based on conjugate gradient update and pixel centric spectral block features |
| topic | Backpropagation (BP) conjugate gradient (CG) deep belief network (DBN) hyperspectral image classification pixel-centric spectral block features 2-norm |
| url | https://ieeexplore.ieee.org/document/9139188/ |
| work_keys_str_mv | AT chenchen hyperspectralclassificationusingdeepbeliefnetworksbasedonconjugategradientupdateandpixelcentricspectralblockfeatures AT yima hyperspectralclassificationusingdeepbeliefnetworksbasedonconjugategradientupdateandpixelcentricspectralblockfeatures AT guangboren hyperspectralclassificationusingdeepbeliefnetworksbasedonconjugategradientupdateandpixelcentricspectralblockfeatures |