Post Disaster Damage Assessment Using Ultra-High-Resolution Aerial Imagery with Semi-Supervised Transformers
Preliminary damage assessments (PDA) conducted in the aftermath of a disaster are a key first step in ensuring a resilient recovery. Conventional door-to-door inspection practices are time-consuming and may delay governmental resource allocation. A number of research efforts have proposed frameworks...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-10-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/23/19/8235 |
| _version_ | 1797575148715376640 |
|---|---|
| author | Deepank Kumar Singh Vedhus Hoskere |
| author_facet | Deepank Kumar Singh Vedhus Hoskere |
| author_sort | Deepank Kumar Singh |
| collection | DOAJ |
| description | Preliminary damage assessments (PDA) conducted in the aftermath of a disaster are a key first step in ensuring a resilient recovery. Conventional door-to-door inspection practices are time-consuming and may delay governmental resource allocation. A number of research efforts have proposed frameworks to automate PDA, typically relying on data sources from satellites, unmanned aerial vehicles, or ground vehicles, together with data processing using deep convolutional neural networks. However, before such frameworks can be adopted in practice, the accuracy and fidelity of predictions of damage level at the scale of an entire building must be comparable to human assessments. Towards this goal, we propose a PDA framework leveraging novel ultra-high-resolution aerial (UHRA) images combined with state-of-the-art transformer models to make multi-class damage predictions of entire buildings. We demonstrate that semi-supervised transformer models trained with vast amounts of unlabeled data are able to surpass the accuracy and generalization capabilities of state-of-the-art PDA frameworks. In our series of experiments, we aim to assess the impact of incorporating unlabeled data, as well as the use of different data sources and model architectures. By integrating UHRA images and semi-supervised transformer models, our results suggest that the framework can overcome the significant limitations of satellite imagery and traditional CNN models, leading to more accurate and efficient damage assessments. |
| first_indexed | 2024-03-10T21:34:35Z |
| format | Article |
| id | doaj.art-555995c1c5e843ff895e1ecbfa99c338 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-10T21:34:35Z |
| publishDate | 2023-10-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-555995c1c5e843ff895e1ecbfa99c3382023-11-19T15:04:40ZengMDPI AGSensors1424-82202023-10-012319823510.3390/s23198235Post Disaster Damage Assessment Using Ultra-High-Resolution Aerial Imagery with Semi-Supervised TransformersDeepank Kumar Singh0Vedhus Hoskere1Department of Civil and Environmental Engineering, University of Houston, Houston, TX 77204, USADepartment of Civil and Environmental Engineering, University of Houston, Houston, TX 77204, USAPreliminary damage assessments (PDA) conducted in the aftermath of a disaster are a key first step in ensuring a resilient recovery. Conventional door-to-door inspection practices are time-consuming and may delay governmental resource allocation. A number of research efforts have proposed frameworks to automate PDA, typically relying on data sources from satellites, unmanned aerial vehicles, or ground vehicles, together with data processing using deep convolutional neural networks. However, before such frameworks can be adopted in practice, the accuracy and fidelity of predictions of damage level at the scale of an entire building must be comparable to human assessments. Towards this goal, we propose a PDA framework leveraging novel ultra-high-resolution aerial (UHRA) images combined with state-of-the-art transformer models to make multi-class damage predictions of entire buildings. We demonstrate that semi-supervised transformer models trained with vast amounts of unlabeled data are able to surpass the accuracy and generalization capabilities of state-of-the-art PDA frameworks. In our series of experiments, we aim to assess the impact of incorporating unlabeled data, as well as the use of different data sources and model architectures. By integrating UHRA images and semi-supervised transformer models, our results suggest that the framework can overcome the significant limitations of satellite imagery and traditional CNN models, leading to more accurate and efficient damage assessments.https://www.mdpi.com/1424-8220/23/19/8235preliminary damage assessmentstransformerssemi-supervised learningaerial imagery |
| spellingShingle | Deepank Kumar Singh Vedhus Hoskere Post Disaster Damage Assessment Using Ultra-High-Resolution Aerial Imagery with Semi-Supervised Transformers Sensors preliminary damage assessments transformers semi-supervised learning aerial imagery |
| title | Post Disaster Damage Assessment Using Ultra-High-Resolution Aerial Imagery with Semi-Supervised Transformers |
| title_full | Post Disaster Damage Assessment Using Ultra-High-Resolution Aerial Imagery with Semi-Supervised Transformers |
| title_fullStr | Post Disaster Damage Assessment Using Ultra-High-Resolution Aerial Imagery with Semi-Supervised Transformers |
| title_full_unstemmed | Post Disaster Damage Assessment Using Ultra-High-Resolution Aerial Imagery with Semi-Supervised Transformers |
| title_short | Post Disaster Damage Assessment Using Ultra-High-Resolution Aerial Imagery with Semi-Supervised Transformers |
| title_sort | post disaster damage assessment using ultra high resolution aerial imagery with semi supervised transformers |
| topic | preliminary damage assessments transformers semi-supervised learning aerial imagery |
| url | https://www.mdpi.com/1424-8220/23/19/8235 |
| work_keys_str_mv | AT deepankkumarsingh postdisasterdamageassessmentusingultrahighresolutionaerialimagerywithsemisupervisedtransformers AT vedhushoskere postdisasterdamageassessmentusingultrahighresolutionaerialimagerywithsemisupervisedtransformers |