Self-Filtered Learning for Semantic Segmentation of Buildings in Remote Sensing Imagery With Noisy Labels
Not all building labels for training improve the performance of the deep learning model. Some labels can be falsely labeled or too ambiguous to represent their ground truths, resulting in poor performance of the model. For example, building labels in OpenStreetMap (OSM) and Microsoft Building Footpr...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9992041/ |
| _version_ | 1827362044691611648 |
|---|---|
| author | Hunsoo Song Lexie Yang Jinha Jung |
| author_facet | Hunsoo Song Lexie Yang Jinha Jung |
| author_sort | Hunsoo Song |
| collection | DOAJ |
| description | Not all building labels for training improve the performance of the deep learning model. Some labels can be falsely labeled or too ambiguous to represent their ground truths, resulting in poor performance of the model. For example, building labels in OpenStreetMap (OSM) and Microsoft Building Footprints (MBF) are publicly available training sources that have great potential to train deep models, but directly using those labels for training can limit the model's performance as their labels are incomplete and inaccurate, called noisy labels. This article presents self-filtered learning (SFL) that helps a deep model learn well with noisy labels for building extraction in remote sensing images. SFL iteratively filters out noisy labels during the training process based on loss of samples. Through a multiround manner, SFL makes a deep model learn progressively more on refined samples from which the noisy labels have been removed. Extensive experiments with the simulated noisy map as well as real-world noisy maps, OSM and MBF, showed that SFL can improve the deep model's performance in diverse error types and different noise levels. |
| first_indexed | 2024-03-08T07:19:17Z |
| format | Article |
| id | doaj.art-524106097f394f87b6a68c674924e4bd |
| institution | Directory Open Access Journal |
| issn | 2151-1535 |
| language | English |
| last_indexed | 2024-03-08T07:19:17Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| spelling | doaj.art-524106097f394f87b6a68c674924e4bd2024-02-03T00:01:48ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352023-01-01161113112910.1109/JSTARS.2022.32306259992041Self-Filtered Learning for Semantic Segmentation of Buildings in Remote Sensing Imagery With Noisy LabelsHunsoo Song0https://orcid.org/0000-0001-6899-6770Lexie Yang1https://orcid.org/0000-0003-2252-6778Jinha Jung2https://orcid.org/0000-0003-1176-3540Lyles School of Civil Engineering, Purdue University, West Lafayette, IN, USANational Security Sciences Directorate, Oak Ridge National Laboratory, Oak Ridge, TN, USANational Security Sciences Directorate, Oak Ridge National Laboratory, Oak Ridge, TN, USANot all building labels for training improve the performance of the deep learning model. Some labels can be falsely labeled or too ambiguous to represent their ground truths, resulting in poor performance of the model. For example, building labels in OpenStreetMap (OSM) and Microsoft Building Footprints (MBF) are publicly available training sources that have great potential to train deep models, but directly using those labels for training can limit the model's performance as their labels are incomplete and inaccurate, called noisy labels. This article presents self-filtered learning (SFL) that helps a deep model learn well with noisy labels for building extraction in remote sensing images. SFL iteratively filters out noisy labels during the training process based on loss of samples. Through a multiround manner, SFL makes a deep model learn progressively more on refined samples from which the noisy labels have been removed. Extensive experiments with the simulated noisy map as well as real-world noisy maps, OSM and MBF, showed that SFL can improve the deep model's performance in diverse error types and different noise levels.https://ieeexplore.ieee.org/document/9992041/Building extractiondeep learninglabel noisesemantic segmentationweakly supervised learning (WSL) |
| spellingShingle | Hunsoo Song Lexie Yang Jinha Jung Self-Filtered Learning for Semantic Segmentation of Buildings in Remote Sensing Imagery With Noisy Labels IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Building extraction deep learning label noise semantic segmentation weakly supervised learning (WSL) |
| title | Self-Filtered Learning for Semantic Segmentation of Buildings in Remote Sensing Imagery With Noisy Labels |
| title_full | Self-Filtered Learning for Semantic Segmentation of Buildings in Remote Sensing Imagery With Noisy Labels |
| title_fullStr | Self-Filtered Learning for Semantic Segmentation of Buildings in Remote Sensing Imagery With Noisy Labels |
| title_full_unstemmed | Self-Filtered Learning for Semantic Segmentation of Buildings in Remote Sensing Imagery With Noisy Labels |
| title_short | Self-Filtered Learning for Semantic Segmentation of Buildings in Remote Sensing Imagery With Noisy Labels |
| title_sort | self filtered learning for semantic segmentation of buildings in remote sensing imagery with noisy labels |
| topic | Building extraction deep learning label noise semantic segmentation weakly supervised learning (WSL) |
| url | https://ieeexplore.ieee.org/document/9992041/ |
| work_keys_str_mv | AT hunsoosong selffilteredlearningforsemanticsegmentationofbuildingsinremotesensingimagerywithnoisylabels AT lexieyang selffilteredlearningforsemanticsegmentationofbuildingsinremotesensingimagerywithnoisylabels AT jinhajung selffilteredlearningforsemanticsegmentationofbuildingsinremotesensingimagerywithnoisylabels |