Full-Learning Rotational Quaternion Convolutional Neural Networks and Confluence of Differently Represented Data for PolSAR Land Classification
Quaternion convolutional neural networks (QCNNs) expand the range of their applications in processing optical and polarimetric synthetic aperture radar (PolSAR) images. Conventional real-valued convolutional neural networks (RVCNNs) compress a three-channel input image into a single-channel feature...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9755119/ |
| _version_ | 1797947281475895296 |
|---|---|
| author | Yuya Matsumoto Ryo Natsuaki Akira Hirose |
| author_facet | Yuya Matsumoto Ryo Natsuaki Akira Hirose |
| author_sort | Yuya Matsumoto |
| collection | DOAJ |
| description | Quaternion convolutional neural networks (QCNNs) expand the range of their applications in processing optical and polarimetric synthetic aperture radar (PolSAR) images. Conventional real-valued convolutional neural networks (RVCNNs) compress a three-channel input image into a single-channel feature map and ignore the relationship among the channels. In contrast, QCNNs deal with the input image as a single quaternion matrix and perform quaternion operation without the reduction of the channels. They can learn the interrelationship among the channel components. Though there exist two types of QCNNs, they have problems, respectively. One type conducts physically unclear quaternion convolution by using simple quaternionic multiplications. The other employs quaternion rotations with fixed axes, resulting in impairment of expression ability. In this article, we propose full-learning rotational QCNNs, which perform quaternion rotation in convolution, and update all the four parameters of a quaternion weight by backpropagation. They realize quaternion rotational convolution with high expression ability. We also propose using two different kinds of features, namely PolSAR pseudocolor features and Stokes vectors normalized by their total power. These two features allow neural networks to learn totally different characteristics of land surface. We train two networks with these features independently. Then, we merge their two classification results to obtain final decision to compensate for the shortcomings of the respective features. Experiments demonstrate that our proposed QCNNs show better classification performance than that of RVCNNs and the two existing QCNNs. We also find that the combination of the two features improves final classification results measured by F-scores. |
| first_indexed | 2024-04-10T21:25:21Z |
| format | Article |
| id | doaj.art-b4079bdaa30545a592782464bb59adc0 |
| institution | Directory Open Access Journal |
| issn | 2151-1535 |
| language | English |
| last_indexed | 2024-04-10T21:25:21Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| spelling | doaj.art-b4079bdaa30545a592782464bb59adc02023-01-20T00:00:10ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352022-01-01152914292810.1109/JSTARS.2022.31644319755119Full-Learning Rotational Quaternion Convolutional Neural Networks and Confluence of Differently Represented Data for PolSAR Land ClassificationYuya Matsumoto0https://orcid.org/0000-0002-6483-5854Ryo Natsuaki1https://orcid.org/0000-0003-2291-4375Akira Hirose2https://orcid.org/0000-0002-6936-9733Department of Electrical Engineering and Information Systems, The University of Tokyo, Bunkyo-ku, JapanDepartment of Electrical Engineering and Information Systems, The University of Tokyo, Bunkyo-ku, JapanDepartment of Electrical Engineering and Information Systems, The University of Tokyo, Bunkyo-ku, JapanQuaternion convolutional neural networks (QCNNs) expand the range of their applications in processing optical and polarimetric synthetic aperture radar (PolSAR) images. Conventional real-valued convolutional neural networks (RVCNNs) compress a three-channel input image into a single-channel feature map and ignore the relationship among the channels. In contrast, QCNNs deal with the input image as a single quaternion matrix and perform quaternion operation without the reduction of the channels. They can learn the interrelationship among the channel components. Though there exist two types of QCNNs, they have problems, respectively. One type conducts physically unclear quaternion convolution by using simple quaternionic multiplications. The other employs quaternion rotations with fixed axes, resulting in impairment of expression ability. In this article, we propose full-learning rotational QCNNs, which perform quaternion rotation in convolution, and update all the four parameters of a quaternion weight by backpropagation. They realize quaternion rotational convolution with high expression ability. We also propose using two different kinds of features, namely PolSAR pseudocolor features and Stokes vectors normalized by their total power. These two features allow neural networks to learn totally different characteristics of land surface. We train two networks with these features independently. Then, we merge their two classification results to obtain final decision to compensate for the shortcomings of the respective features. Experiments demonstrate that our proposed QCNNs show better classification performance than that of RVCNNs and the two existing QCNNs. We also find that the combination of the two features improves final classification results measured by F-scores.https://ieeexplore.ieee.org/document/9755119/Convolutional neural network (CNN)polarimetric synthetic aperture radar (PolSAR)quaternion neural network (QNN) |
| spellingShingle | Yuya Matsumoto Ryo Natsuaki Akira Hirose Full-Learning Rotational Quaternion Convolutional Neural Networks and Confluence of Differently Represented Data for PolSAR Land Classification IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Convolutional neural network (CNN) polarimetric synthetic aperture radar (PolSAR) quaternion neural network (QNN) |
| title | Full-Learning Rotational Quaternion Convolutional Neural Networks and Confluence of Differently Represented Data for PolSAR Land Classification |
| title_full | Full-Learning Rotational Quaternion Convolutional Neural Networks and Confluence of Differently Represented Data for PolSAR Land Classification |
| title_fullStr | Full-Learning Rotational Quaternion Convolutional Neural Networks and Confluence of Differently Represented Data for PolSAR Land Classification |
| title_full_unstemmed | Full-Learning Rotational Quaternion Convolutional Neural Networks and Confluence of Differently Represented Data for PolSAR Land Classification |
| title_short | Full-Learning Rotational Quaternion Convolutional Neural Networks and Confluence of Differently Represented Data for PolSAR Land Classification |
| title_sort | full learning rotational quaternion convolutional neural networks and confluence of differently represented data for polsar land classification |
| topic | Convolutional neural network (CNN) polarimetric synthetic aperture radar (PolSAR) quaternion neural network (QNN) |
| url | https://ieeexplore.ieee.org/document/9755119/ |
| work_keys_str_mv | AT yuyamatsumoto fulllearningrotationalquaternionconvolutionalneuralnetworksandconfluenceofdifferentlyrepresenteddataforpolsarlandclassification AT ryonatsuaki fulllearningrotationalquaternionconvolutionalneuralnetworksandconfluenceofdifferentlyrepresenteddataforpolsarlandclassification AT akirahirose fulllearningrotationalquaternionconvolutionalneuralnetworksandconfluenceofdifferentlyrepresenteddataforpolsarlandclassification |