A Novel GAN-Based Anomaly Detection and Localization Method for Aerial Video Surveillance at Low Altitude
The last two decades have seen an incessant growth in the use of Unmanned Aerial Vehicles (UAVs) equipped with HD cameras for developing aerial vision-based systems to support civilian and military tasks, including land monitoring, change detection, and object classification. To perform most of thes...
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-08-01
|
| Series: | Remote Sensing |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-4292/14/16/4110 |
| _version_ | 1827598478560198656 |
|---|---|
| author | Danilo Avola Irene Cannistraci Marco Cascio Luigi Cinque Anxhelo Diko Alessio Fagioli Gian Luca Foresti Romeo Lanzino Maurizio Mancini Alessio Mecca Daniele Pannone |
| author_facet | Danilo Avola Irene Cannistraci Marco Cascio Luigi Cinque Anxhelo Diko Alessio Fagioli Gian Luca Foresti Romeo Lanzino Maurizio Mancini Alessio Mecca Daniele Pannone |
| author_sort | Danilo Avola |
| collection | DOAJ |
| description | The last two decades have seen an incessant growth in the use of Unmanned Aerial Vehicles (UAVs) equipped with HD cameras for developing aerial vision-based systems to support civilian and military tasks, including land monitoring, change detection, and object classification. To perform most of these tasks, the artificial intelligence algorithms usually need to know, a priori, what to look for, identify. or recognize. Actually, in most operational scenarios, such as war zones or post-disaster situations, areas and objects of interest are not decidable a priori since their shape and visual features may have been altered by events or even intentionally disguised (e.g., improvised explosive devices (IEDs)). For these reasons, in recent years, more and more research groups are investigating the design of original anomaly detection methods, which, in short, are focused on detecting samples that differ from the others in terms of visual appearance and occurrences with respect to a given environment. In this paper, we present a novel two-branch Generative Adversarial Network (GAN)-based method for low-altitude RGB aerial video surveillance to detect and localize anomalies. We have chosen to focus on the low-altitude sequences as we are interested in complex operational scenarios where even a small object or device can represent a reason for danger or attention. The proposed model was tested on the UAV Mosaicking and Change Detection (UMCD) dataset, a one-of-a-kind collection of challenging videos whose sequences were acquired between 6 and 15 m above sea level on three types of ground (i.e., urban, dirt, and countryside). Results demonstrated the effectiveness of the model in terms of Area Under the Receiving Operating Curve (AUROC) and Structural Similarity Index (SSIM), achieving an average of 97.2% and 95.7%, respectively, thus suggesting that the system can be deployed in real-world applications. |
| first_indexed | 2024-03-09T03:52:30Z |
| format | Article |
| id | doaj.art-74783ab336fb421598e685eedc35509b |
| institution | Directory Open Access Journal |
| issn | 2072-4292 |
| language | English |
| last_indexed | 2024-03-09T03:52:30Z |
| publishDate | 2022-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Remote Sensing |
| spelling | doaj.art-74783ab336fb421598e685eedc35509b2023-12-03T14:25:07ZengMDPI AGRemote Sensing2072-42922022-08-011416411010.3390/rs14164110A Novel GAN-Based Anomaly Detection and Localization Method for Aerial Video Surveillance at Low AltitudeDanilo Avola0Irene Cannistraci1Marco Cascio2Luigi Cinque3Anxhelo Diko4Alessio Fagioli5Gian Luca Foresti6Romeo Lanzino7Maurizio Mancini8Alessio Mecca9Daniele Pannone10Department of Computer Science, Sapienza University, 00198 Rome, ItalyDepartment of Computer Science, Sapienza University, 00198 Rome, ItalyDepartment of Computer Science, Sapienza University, 00198 Rome, ItalyDepartment of Computer Science, Sapienza University, 00198 Rome, ItalyDepartment of Computer Science, Sapienza University, 00198 Rome, ItalyDepartment of Computer Science, Sapienza University, 00198 Rome, ItalyDepartment of Mathematics, Computer Science and Physics, University of Udine, 33100 Udine, ItalyDepartment of Computer Science, Sapienza University, 00198 Rome, ItalyDepartment of Computer Science, Sapienza University, 00198 Rome, ItalyDepartment of Mathematics, Computer Science and Physics, University of Udine, 33100 Udine, ItalyDepartment of Computer Science, Sapienza University, 00198 Rome, ItalyThe last two decades have seen an incessant growth in the use of Unmanned Aerial Vehicles (UAVs) equipped with HD cameras for developing aerial vision-based systems to support civilian and military tasks, including land monitoring, change detection, and object classification. To perform most of these tasks, the artificial intelligence algorithms usually need to know, a priori, what to look for, identify. or recognize. Actually, in most operational scenarios, such as war zones or post-disaster situations, areas and objects of interest are not decidable a priori since their shape and visual features may have been altered by events or even intentionally disguised (e.g., improvised explosive devices (IEDs)). For these reasons, in recent years, more and more research groups are investigating the design of original anomaly detection methods, which, in short, are focused on detecting samples that differ from the others in terms of visual appearance and occurrences with respect to a given environment. In this paper, we present a novel two-branch Generative Adversarial Network (GAN)-based method for low-altitude RGB aerial video surveillance to detect and localize anomalies. We have chosen to focus on the low-altitude sequences as we are interested in complex operational scenarios where even a small object or device can represent a reason for danger or attention. The proposed model was tested on the UAV Mosaicking and Change Detection (UMCD) dataset, a one-of-a-kind collection of challenging videos whose sequences were acquired between 6 and 15 m above sea level on three types of ground (i.e., urban, dirt, and countryside). Results demonstrated the effectiveness of the model in terms of Area Under the Receiving Operating Curve (AUROC) and Structural Similarity Index (SSIM), achieving an average of 97.2% and 95.7%, respectively, thus suggesting that the system can be deployed in real-world applications.https://www.mdpi.com/2072-4292/14/16/4110UAVscomputer visionanomaly detectionaerial imageslow-altitudeUMCD dataset |
| spellingShingle | Danilo Avola Irene Cannistraci Marco Cascio Luigi Cinque Anxhelo Diko Alessio Fagioli Gian Luca Foresti Romeo Lanzino Maurizio Mancini Alessio Mecca Daniele Pannone A Novel GAN-Based Anomaly Detection and Localization Method for Aerial Video Surveillance at Low Altitude Remote Sensing UAVs computer vision anomaly detection aerial images low-altitude UMCD dataset |
| title | A Novel GAN-Based Anomaly Detection and Localization Method for Aerial Video Surveillance at Low Altitude |
| title_full | A Novel GAN-Based Anomaly Detection and Localization Method for Aerial Video Surveillance at Low Altitude |
| title_fullStr | A Novel GAN-Based Anomaly Detection and Localization Method for Aerial Video Surveillance at Low Altitude |
| title_full_unstemmed | A Novel GAN-Based Anomaly Detection and Localization Method for Aerial Video Surveillance at Low Altitude |
| title_short | A Novel GAN-Based Anomaly Detection and Localization Method for Aerial Video Surveillance at Low Altitude |
| title_sort | novel gan based anomaly detection and localization method for aerial video surveillance at low altitude |
| topic | UAVs computer vision anomaly detection aerial images low-altitude UMCD dataset |
| url | https://www.mdpi.com/2072-4292/14/16/4110 |
| work_keys_str_mv | AT daniloavola anovelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT irenecannistraci anovelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT marcocascio anovelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT luigicinque anovelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT anxhelodiko anovelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT alessiofagioli anovelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT gianlucaforesti anovelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT romeolanzino anovelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT mauriziomancini anovelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT alessiomecca anovelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT danielepannone anovelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT daniloavola novelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT irenecannistraci novelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT marcocascio novelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT luigicinque novelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT anxhelodiko novelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT alessiofagioli novelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT gianlucaforesti novelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT romeolanzino novelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT mauriziomancini novelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT alessiomecca novelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude AT danielepannone novelganbasedanomalydetectionandlocalizationmethodforaerialvideosurveillanceatlowaltitude |