A Rapid Self-Supervised Deep-Learning-Based Method for Post-Earthquake Damage Detection Using UAV Data (Case Study: Sarpol-e Zahab, Iran)
Immediately after an earthquake, rapid disaster management is the main challenge for relevant organizations. While satellite images have been used in the past two decades for building-damage mapping, they have rarely been utilized for the timely damage monitoring required for rescue operations. Unma...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-12-01
|
| Series: | Remote Sensing |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-4292/15/1/123 |
| _version_ | 1797406438613581824 |
|---|---|
| author | Narges Takhtkeshha Ali Mohammadzadeh Bahram Salehi |
| author_facet | Narges Takhtkeshha Ali Mohammadzadeh Bahram Salehi |
| author_sort | Narges Takhtkeshha |
| collection | DOAJ |
| description | Immediately after an earthquake, rapid disaster management is the main challenge for relevant organizations. While satellite images have been used in the past two decades for building-damage mapping, they have rarely been utilized for the timely damage monitoring required for rescue operations. Unmanned aerial vehicles (UAVs) have recently become very popular due to their agile deployment to sites, super-high spatial resolution, and relatively low operating cost. This paper proposes a novel deep-learning-based method for rapid post-earthquake building damage detection. The method detects damages in four levels and consists of three steps. First, three different feature types—non-deep, deep, and their fusion—are investigated to determine the optimal feature extraction method. A “one-epoch convolutional autoencoder (OECAE)” is used to extract deep features from non-deep features. Then, a rule-based procedure is designed for the automatic selection of the proper training samples required by the classification algorithms in the next step. Finally, seven famous machine learning (ML) algorithms—including support vector machine (SVM), random forest (RF), gradient boosting (GB), extreme gradient boosting (XGB), decision trees (DT), k-nearest neighbors (KNN), and adaBoost (AB)—and a basic deep learning algorithm (i.e., multi-layer perceptron (MLP)) are implemented to obtain building damage maps. The results indicated that auto-training samples are feasible and superior to manual ones, with improved overall accuracy (OA) and kappa coefficient (KC) over 22% and 33%, respectively; SVM (OA = 82% and KC = 74.01%) was the most accurate AI model with a slight advantage over MLP (OA = 82% and KC = 73.98%). Additionally, it was found that the fusion of deep and non-deep features using OECAE could significantly enhance damage-mapping efficiency compared to those using either non-deep features (by an average improvement of 6.75% and 9.78% in OA and KC, respectively) or deep features (improving OA by 7.19% and KC by 10.18% on average) alone. |
| first_indexed | 2024-03-09T03:26:29Z |
| format | Article |
| id | doaj.art-74101b12c1d54b8e82e0c4d7a9185f96 |
| institution | Directory Open Access Journal |
| issn | 2072-4292 |
| language | English |
| last_indexed | 2024-03-09T03:26:29Z |
| publishDate | 2022-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Remote Sensing |
| spelling | doaj.art-74101b12c1d54b8e82e0c4d7a9185f962023-12-03T15:02:20ZengMDPI AGRemote Sensing2072-42922022-12-0115112310.3390/rs15010123A Rapid Self-Supervised Deep-Learning-Based Method for Post-Earthquake Damage Detection Using UAV Data (Case Study: Sarpol-e Zahab, Iran)Narges Takhtkeshha0Ali Mohammadzadeh1Bahram Salehi2Department of Photogrammetry and Remote Sensing, K. N. Toosi University of Technology, Tehran 19967-15433, IranDepartment of Photogrammetry and Remote Sensing, K. N. Toosi University of Technology, Tehran 19967-15433, IranCollege of Environmental Science and Forestry, State University of New York, Syracuse, NY 13210, USAImmediately after an earthquake, rapid disaster management is the main challenge for relevant organizations. While satellite images have been used in the past two decades for building-damage mapping, they have rarely been utilized for the timely damage monitoring required for rescue operations. Unmanned aerial vehicles (UAVs) have recently become very popular due to their agile deployment to sites, super-high spatial resolution, and relatively low operating cost. This paper proposes a novel deep-learning-based method for rapid post-earthquake building damage detection. The method detects damages in four levels and consists of three steps. First, three different feature types—non-deep, deep, and their fusion—are investigated to determine the optimal feature extraction method. A “one-epoch convolutional autoencoder (OECAE)” is used to extract deep features from non-deep features. Then, a rule-based procedure is designed for the automatic selection of the proper training samples required by the classification algorithms in the next step. Finally, seven famous machine learning (ML) algorithms—including support vector machine (SVM), random forest (RF), gradient boosting (GB), extreme gradient boosting (XGB), decision trees (DT), k-nearest neighbors (KNN), and adaBoost (AB)—and a basic deep learning algorithm (i.e., multi-layer perceptron (MLP)) are implemented to obtain building damage maps. The results indicated that auto-training samples are feasible and superior to manual ones, with improved overall accuracy (OA) and kappa coefficient (KC) over 22% and 33%, respectively; SVM (OA = 82% and KC = 74.01%) was the most accurate AI model with a slight advantage over MLP (OA = 82% and KC = 73.98%). Additionally, it was found that the fusion of deep and non-deep features using OECAE could significantly enhance damage-mapping efficiency compared to those using either non-deep features (by an average improvement of 6.75% and 9.78% in OA and KC, respectively) or deep features (improving OA by 7.19% and KC by 10.18% on average) alone.https://www.mdpi.com/2072-4292/15/1/123damage mappingself-superviseddeep learningunmanned aerial vehicleearthquake management |
| spellingShingle | Narges Takhtkeshha Ali Mohammadzadeh Bahram Salehi A Rapid Self-Supervised Deep-Learning-Based Method for Post-Earthquake Damage Detection Using UAV Data (Case Study: Sarpol-e Zahab, Iran) Remote Sensing damage mapping self-supervised deep learning unmanned aerial vehicle earthquake management |
| title | A Rapid Self-Supervised Deep-Learning-Based Method for Post-Earthquake Damage Detection Using UAV Data (Case Study: Sarpol-e Zahab, Iran) |
| title_full | A Rapid Self-Supervised Deep-Learning-Based Method for Post-Earthquake Damage Detection Using UAV Data (Case Study: Sarpol-e Zahab, Iran) |
| title_fullStr | A Rapid Self-Supervised Deep-Learning-Based Method for Post-Earthquake Damage Detection Using UAV Data (Case Study: Sarpol-e Zahab, Iran) |
| title_full_unstemmed | A Rapid Self-Supervised Deep-Learning-Based Method for Post-Earthquake Damage Detection Using UAV Data (Case Study: Sarpol-e Zahab, Iran) |
| title_short | A Rapid Self-Supervised Deep-Learning-Based Method for Post-Earthquake Damage Detection Using UAV Data (Case Study: Sarpol-e Zahab, Iran) |
| title_sort | rapid self supervised deep learning based method for post earthquake damage detection using uav data case study sarpol e zahab iran |
| topic | damage mapping self-supervised deep learning unmanned aerial vehicle earthquake management |
| url | https://www.mdpi.com/2072-4292/15/1/123 |
| work_keys_str_mv | AT nargestakhtkeshha arapidselfsuperviseddeeplearningbasedmethodforpostearthquakedamagedetectionusinguavdatacasestudysarpolezahabiran AT alimohammadzadeh arapidselfsuperviseddeeplearningbasedmethodforpostearthquakedamagedetectionusinguavdatacasestudysarpolezahabiran AT bahramsalehi arapidselfsuperviseddeeplearningbasedmethodforpostearthquakedamagedetectionusinguavdatacasestudysarpolezahabiran AT nargestakhtkeshha rapidselfsuperviseddeeplearningbasedmethodforpostearthquakedamagedetectionusinguavdatacasestudysarpolezahabiran AT alimohammadzadeh rapidselfsuperviseddeeplearningbasedmethodforpostearthquakedamagedetectionusinguavdatacasestudysarpolezahabiran AT bahramsalehi rapidselfsuperviseddeeplearningbasedmethodforpostearthquakedamagedetectionusinguavdatacasestudysarpolezahabiran |