DeepForest: Novel Deep Learning Models for Land Use and Land Cover Classification Using Multi-Temporal and -Modal Sentinel Data of the Amazon Basin
Land use and land cover (LULC) mapping is a powerful tool for monitoring large areas. For the Amazon rainforest, automated mapping is of critical importance, as land cover is changing rapidly due to forest degradation and deforestation. Several research groups have addressed this challenge by conduc...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-10-01
|
| Series: | Remote Sensing |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-4292/14/19/5000 |
| _version_ | 1797477111077797888 |
|---|---|
| author | Eya Cherif Maximilian Hell Melanie Brandmeier |
| author_facet | Eya Cherif Maximilian Hell Melanie Brandmeier |
| author_sort | Eya Cherif |
| collection | DOAJ |
| description | Land use and land cover (LULC) mapping is a powerful tool for monitoring large areas. For the Amazon rainforest, automated mapping is of critical importance, as land cover is changing rapidly due to forest degradation and deforestation. Several research groups have addressed this challenge by conducting local surveys and producing maps using freely available remote sensing data. However, automating the process of large-scale land cover mapping remains one of the biggest challenges in the remote sensing community. One issue when using supervised learning is the scarcity of labeled training data. One way to address this problem is to make use of already available maps produced with (semi-) automated classifiers. This is also known as weakly supervised learning. The present study aims to develop novel methods for automated LULC classification in the cloud-prone Amazon basin (Brazil) based on the labels from the MapBiomas project, which include twelve classes. We investigate different fusion techniques for multi-spectral Sentinel-2 data and synthetic aperture radar Sentinel-1 time-series from 2018. The newly designed deep learning architectures—DeepForest-1 and DeepForest-2—utilize spatiotemporal characteristics, as well as multi-scale representations of the data. In several data scenarios, the models are compared to state-of-the-art (SotA) models, such as U-Net and DeepLab. The proposed networks reach an overall accuracy of up to 75.0%, similar to the SotA models. However, the novel approaches outperform the SotA models with respect to underrepresented classes. Forest, savanna and crop were mapped best, with F1 scores up to 85.0% when combining multi-modal data, compared to 81.6% reached by DeepLab. Furthermore, in a qualitative analysis, we highlight that the classifiers sometimes outperform the inaccurate labels. |
| first_indexed | 2024-03-09T21:13:04Z |
| format | Article |
| id | doaj.art-7a963727738644b8b499e7957fe77d7d |
| institution | Directory Open Access Journal |
| issn | 2072-4292 |
| language | English |
| last_indexed | 2024-03-09T21:13:04Z |
| publishDate | 2022-10-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Remote Sensing |
| spelling | doaj.art-7a963727738644b8b499e7957fe77d7d2023-11-23T21:42:13ZengMDPI AGRemote Sensing2072-42922022-10-011419500010.3390/rs14195000DeepForest: Novel Deep Learning Models for Land Use and Land Cover Classification Using Multi-Temporal and -Modal Sentinel Data of the Amazon BasinEya Cherif0Maximilian Hell1Melanie Brandmeier2Center for Scalable Data Analytics and Artificial Intelligence, Leipzig University, Humboldtstr. 25, 04105 Leipzig, GermanyFaculty of Plastics Engineering and Surveying, University of Applied Sciences Würzburg-Schweinfurt, Röntgenring 8, 97070 Würzburg, GermanyFaculty of Plastics Engineering and Surveying, University of Applied Sciences Würzburg-Schweinfurt, Röntgenring 8, 97070 Würzburg, GermanyLand use and land cover (LULC) mapping is a powerful tool for monitoring large areas. For the Amazon rainforest, automated mapping is of critical importance, as land cover is changing rapidly due to forest degradation and deforestation. Several research groups have addressed this challenge by conducting local surveys and producing maps using freely available remote sensing data. However, automating the process of large-scale land cover mapping remains one of the biggest challenges in the remote sensing community. One issue when using supervised learning is the scarcity of labeled training data. One way to address this problem is to make use of already available maps produced with (semi-) automated classifiers. This is also known as weakly supervised learning. The present study aims to develop novel methods for automated LULC classification in the cloud-prone Amazon basin (Brazil) based on the labels from the MapBiomas project, which include twelve classes. We investigate different fusion techniques for multi-spectral Sentinel-2 data and synthetic aperture radar Sentinel-1 time-series from 2018. The newly designed deep learning architectures—DeepForest-1 and DeepForest-2—utilize spatiotemporal characteristics, as well as multi-scale representations of the data. In several data scenarios, the models are compared to state-of-the-art (SotA) models, such as U-Net and DeepLab. The proposed networks reach an overall accuracy of up to 75.0%, similar to the SotA models. However, the novel approaches outperform the SotA models with respect to underrepresented classes. Forest, savanna and crop were mapped best, with F1 scores up to 85.0% when combining multi-modal data, compared to 81.6% reached by DeepLab. Furthermore, in a qualitative analysis, we highlight that the classifiers sometimes outperform the inaccurate labels.https://www.mdpi.com/2072-4292/14/19/5000deep learningland use and land cover classificationSentinel-2Sentinel-1multi-modal and multi-temporal datadata fusion |
| spellingShingle | Eya Cherif Maximilian Hell Melanie Brandmeier DeepForest: Novel Deep Learning Models for Land Use and Land Cover Classification Using Multi-Temporal and -Modal Sentinel Data of the Amazon Basin Remote Sensing deep learning land use and land cover classification Sentinel-2 Sentinel-1 multi-modal and multi-temporal data data fusion |
| title | DeepForest: Novel Deep Learning Models for Land Use and Land Cover Classification Using Multi-Temporal and -Modal Sentinel Data of the Amazon Basin |
| title_full | DeepForest: Novel Deep Learning Models for Land Use and Land Cover Classification Using Multi-Temporal and -Modal Sentinel Data of the Amazon Basin |
| title_fullStr | DeepForest: Novel Deep Learning Models for Land Use and Land Cover Classification Using Multi-Temporal and -Modal Sentinel Data of the Amazon Basin |
| title_full_unstemmed | DeepForest: Novel Deep Learning Models for Land Use and Land Cover Classification Using Multi-Temporal and -Modal Sentinel Data of the Amazon Basin |
| title_short | DeepForest: Novel Deep Learning Models for Land Use and Land Cover Classification Using Multi-Temporal and -Modal Sentinel Data of the Amazon Basin |
| title_sort | deepforest novel deep learning models for land use and land cover classification using multi temporal and modal sentinel data of the amazon basin |
| topic | deep learning land use and land cover classification Sentinel-2 Sentinel-1 multi-modal and multi-temporal data data fusion |
| url | https://www.mdpi.com/2072-4292/14/19/5000 |
| work_keys_str_mv | AT eyacherif deepforestnoveldeeplearningmodelsforlanduseandlandcoverclassificationusingmultitemporalandmodalsentineldataoftheamazonbasin AT maximilianhell deepforestnoveldeeplearningmodelsforlanduseandlandcoverclassificationusingmultitemporalandmodalsentineldataoftheamazonbasin AT melaniebrandmeier deepforestnoveldeeplearningmodelsforlanduseandlandcoverclassificationusingmultitemporalandmodalsentineldataoftheamazonbasin |