Integration of object-based image analysis and convolutional neural network for the classification of high-resolution satellite image: a comparative assessment
During the past decade, deep learning-based classification methods (e.g., convolutional neural networks—CNN) have demonstrated great success in a variety of vision tasks, including satellite image classification. Deep learning methods, on the other hand, do not preserve the precise edges of the targ...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Published: |
Multidisciplinary Digital Publishing Institute
2022
|
| _version_ | 1796984135969931264 |
|---|---|
| author | Azeez, Omer Saud M. Shafri, Helmi Z. Alias, Aidi Hizami Haron, Nuzul A. |
| author_facet | Azeez, Omer Saud M. Shafri, Helmi Z. Alias, Aidi Hizami Haron, Nuzul A. |
| author_sort | Azeez, Omer Saud |
| collection | UPM |
| description | During the past decade, deep learning-based classification methods (e.g., convolutional neural networks—CNN) have demonstrated great success in a variety of vision tasks, including satellite image classification. Deep learning methods, on the other hand, do not preserve the precise edges of the targets of interest and do not extract geometric features such as shape and area. Previous research has attempted to address such issues by combining deep learning with methods such as object-based image analysis (OBIA). Nonetheless, the question of how to integrate those methods into a single framework in such a way that the benefits of each method complement each other remains. To that end, this study compared four integration frameworks in terms of accuracy, namely OBIA artificial neural network (OBIA ANN), feature fusion, decision fusion, and patch filtering, according to the results. Patch filtering achieved 0.917 OA, whereas decision fusion and feature fusion achieved 0.862 OA and 0.860 OA, respectively. The integration of CNN and OBIA can improve classification accuracy; however, the integration framework plays a significant role in this. Future research should focus on optimizing the existing CNN and OBIA frameworks in terms of architecture, as well as investigate how CNN models should use OBIA outputs for feature extraction and classification of remotely sensed images. |
| first_indexed | 2024-03-06T11:16:15Z |
| format | Article |
| id | upm.eprints-101946 |
| institution | Universiti Putra Malaysia |
| last_indexed | 2024-03-06T11:16:15Z |
| publishDate | 2022 |
| publisher | Multidisciplinary Digital Publishing Institute |
| record_format | dspace |
| spelling | upm.eprints-1019462023-06-16T20:16:25Z http://psasir.upm.edu.my/id/eprint/101946/ Integration of object-based image analysis and convolutional neural network for the classification of high-resolution satellite image: a comparative assessment Azeez, Omer Saud M. Shafri, Helmi Z. Alias, Aidi Hizami Haron, Nuzul A. During the past decade, deep learning-based classification methods (e.g., convolutional neural networks—CNN) have demonstrated great success in a variety of vision tasks, including satellite image classification. Deep learning methods, on the other hand, do not preserve the precise edges of the targets of interest and do not extract geometric features such as shape and area. Previous research has attempted to address such issues by combining deep learning with methods such as object-based image analysis (OBIA). Nonetheless, the question of how to integrate those methods into a single framework in such a way that the benefits of each method complement each other remains. To that end, this study compared four integration frameworks in terms of accuracy, namely OBIA artificial neural network (OBIA ANN), feature fusion, decision fusion, and patch filtering, according to the results. Patch filtering achieved 0.917 OA, whereas decision fusion and feature fusion achieved 0.862 OA and 0.860 OA, respectively. The integration of CNN and OBIA can improve classification accuracy; however, the integration framework plays a significant role in this. Future research should focus on optimizing the existing CNN and OBIA frameworks in terms of architecture, as well as investigate how CNN models should use OBIA outputs for feature extraction and classification of remotely sensed images. Multidisciplinary Digital Publishing Institute 2022-10-27 Article PeerReviewed Azeez, Omer Saud and M. Shafri, Helmi Z. and Alias, Aidi Hizami and Haron, Nuzul A. (2022) Integration of object-based image analysis and convolutional neural network for the classification of high-resolution satellite image: a comparative assessment. Applied Sciences, 12 (21). art. no. 10890. pp. 1-21. ISSN 2076-3417 https://www.mdpi.com/2076-3417/12/21/10890 10.3390/app122110890 |
| spellingShingle | Azeez, Omer Saud M. Shafri, Helmi Z. Alias, Aidi Hizami Haron, Nuzul A. Integration of object-based image analysis and convolutional neural network for the classification of high-resolution satellite image: a comparative assessment |
| title | Integration of object-based image analysis and convolutional neural network for the classification of high-resolution satellite image: a comparative assessment |
| title_full | Integration of object-based image analysis and convolutional neural network for the classification of high-resolution satellite image: a comparative assessment |
| title_fullStr | Integration of object-based image analysis and convolutional neural network for the classification of high-resolution satellite image: a comparative assessment |
| title_full_unstemmed | Integration of object-based image analysis and convolutional neural network for the classification of high-resolution satellite image: a comparative assessment |
| title_short | Integration of object-based image analysis and convolutional neural network for the classification of high-resolution satellite image: a comparative assessment |
| title_sort | integration of object based image analysis and convolutional neural network for the classification of high resolution satellite image a comparative assessment |
| work_keys_str_mv | AT azeezomersaud integrationofobjectbasedimageanalysisandconvolutionalneuralnetworkfortheclassificationofhighresolutionsatelliteimageacomparativeassessment AT mshafrihelmiz integrationofobjectbasedimageanalysisandconvolutionalneuralnetworkfortheclassificationofhighresolutionsatelliteimageacomparativeassessment AT aliasaidihizami integrationofobjectbasedimageanalysisandconvolutionalneuralnetworkfortheclassificationofhighresolutionsatelliteimageacomparativeassessment AT haronnuzula integrationofobjectbasedimageanalysisandconvolutionalneuralnetworkfortheclassificationofhighresolutionsatelliteimageacomparativeassessment |