Computer vision-based post-disaster needs assessment from low altitude aerial imagery
Over the past decades, climate change has driven an increase in the frequency and intensity of natural disasters. In an effort to increase the situational awareness and timely support for search and rescue missions in the aftermath of a disaster, the United States Civil Air Patrol (CAP) gathers aeri...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2022
|
| Online Access: | https://hdl.handle.net/1721.1/139487 |
| _version_ | 1811081698631221248 |
|---|---|
| author | García Franceschini, René Andrés |
| author2 | Amin, Saurabh |
| author_facet | Amin, Saurabh García Franceschini, René Andrés |
| author_sort | García Franceschini, René Andrés |
| collection | MIT |
| description | Over the past decades, climate change has driven an increase in the frequency and intensity of natural disasters. In an effort to increase the situational awareness and timely support for search and rescue missions in the aftermath of a disaster, the United States Civil Air Patrol (CAP) gathers aerial imagery of the impacted areas. However, these high resolution and timely images are seldom used for quantitative assessment of damage. This thesis focuses on the following question: How can we use modern computer vision techniques to utilize CAP imagery for post-disaster needs assessment, specifically for the purpose of damage estimation and localization? This question is important because the data gathered by CAP has significant potential to expedite response operations and help reduce significant societal costs. The key technical challenge to address is problem arises from the fact that CAP-gathered aerial images are spatially sparse and oblique, and well-calibrated object detection datasets are not available for damage-prone situations.
To address the aforementioned challenge, we develop an approach to simultaneously detect and localize damage within images using ideas from weakly-supervised object localization and structure from motion. Firstly, we refine a well-known proposed technique called class activation mapping to detect the extent of damage within an image solely relying on image-level labels. Secondly, we utilize structure from motion to georeference batches of CAP images from an area of interest. The main advantage of our approach is that the outputs of these two techniques can be easily combined to assign real-world coordinates to damage hotspots in the aftermath of a natural disaster. Finally, we evaluate its potential using data from the 2016 Louisiana floods and provide estimates of flood-related damage.
Our approach achieves a precision of 88% when compared against official flooding estimates. Practical deployment of this approach depends on how the current practices and technologies used by CAP are tailored to improve damage detection and localization. To this end, we propose the following technical and policy recommendations: 1) Implement best practices that allow for a high-quality image sequences that can be labeled and georeferenced using modern computer vision techniques; 2) Incorporate other sensing modalities such as satellite imagery into CAP imagery analysis for quantitative damage assessment over large spatial regions; and 3) Invest in low altitude imaging technologies and benchmark dataset development. |
| first_indexed | 2024-09-23T11:51:04Z |
| format | Thesis |
| id | mit-1721.1/139487 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T11:51:04Z |
| publishDate | 2022 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1394872022-01-15T03:38:05Z Computer vision-based post-disaster needs assessment from low altitude aerial imagery García Franceschini, René Andrés Amin, Saurabh Massachusetts Institute of Technology. Institute for Data, Systems, and Society Over the past decades, climate change has driven an increase in the frequency and intensity of natural disasters. In an effort to increase the situational awareness and timely support for search and rescue missions in the aftermath of a disaster, the United States Civil Air Patrol (CAP) gathers aerial imagery of the impacted areas. However, these high resolution and timely images are seldom used for quantitative assessment of damage. This thesis focuses on the following question: How can we use modern computer vision techniques to utilize CAP imagery for post-disaster needs assessment, specifically for the purpose of damage estimation and localization? This question is important because the data gathered by CAP has significant potential to expedite response operations and help reduce significant societal costs. The key technical challenge to address is problem arises from the fact that CAP-gathered aerial images are spatially sparse and oblique, and well-calibrated object detection datasets are not available for damage-prone situations. To address the aforementioned challenge, we develop an approach to simultaneously detect and localize damage within images using ideas from weakly-supervised object localization and structure from motion. Firstly, we refine a well-known proposed technique called class activation mapping to detect the extent of damage within an image solely relying on image-level labels. Secondly, we utilize structure from motion to georeference batches of CAP images from an area of interest. The main advantage of our approach is that the outputs of these two techniques can be easily combined to assign real-world coordinates to damage hotspots in the aftermath of a natural disaster. Finally, we evaluate its potential using data from the 2016 Louisiana floods and provide estimates of flood-related damage. Our approach achieves a precision of 88% when compared against official flooding estimates. Practical deployment of this approach depends on how the current practices and technologies used by CAP are tailored to improve damage detection and localization. To this end, we propose the following technical and policy recommendations: 1) Implement best practices that allow for a high-quality image sequences that can be labeled and georeferenced using modern computer vision techniques; 2) Incorporate other sensing modalities such as satellite imagery into CAP imagery analysis for quantitative damage assessment over large spatial regions; and 3) Invest in low altitude imaging technologies and benchmark dataset development. S.M. 2022-01-14T15:14:57Z 2022-01-14T15:14:57Z 2021-06 2021-06-11T14:54:11.955Z Thesis https://hdl.handle.net/1721.1/139487 In Copyright - Educational Use Permitted Copyright MIT http://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | García Franceschini, René Andrés Computer vision-based post-disaster needs assessment from low altitude aerial imagery |
| title | Computer vision-based post-disaster needs assessment from low altitude aerial imagery |
| title_full | Computer vision-based post-disaster needs assessment from low altitude aerial imagery |
| title_fullStr | Computer vision-based post-disaster needs assessment from low altitude aerial imagery |
| title_full_unstemmed | Computer vision-based post-disaster needs assessment from low altitude aerial imagery |
| title_short | Computer vision-based post-disaster needs assessment from low altitude aerial imagery |
| title_sort | computer vision based post disaster needs assessment from low altitude aerial imagery |
| url | https://hdl.handle.net/1721.1/139487 |
| work_keys_str_mv | AT garciafranceschinireneandres computervisionbasedpostdisasterneedsassessmentfromlowaltitudeaerialimagery |