Incremental learning technologies for semantic segmentation
Semantic segmentation models based on deep learning technologies have achieved remarkable results in recent years. However, many models encounter the problem of catastrophic forgetting, i.e. when the model is required to learn a new task without labels for old objects, its performance drops signific...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis-Master by Coursework |
| Language: | English |
| Published: |
Nanyang Technological University
2022
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/157338 |
| _version_ | 1824453650262523904 |
|---|---|
| author | Yang, Yizhuo |
| author2 | Xie Lihua |
| author_facet | Xie Lihua Yang, Yizhuo |
| author_sort | Yang, Yizhuo |
| collection | NTU |
| description | Semantic segmentation models based on deep learning technologies have achieved remarkable results in recent years. However, many models encounter the problem of catastrophic forgetting, i.e. when the model is required to learn a new task without labels for old objects, its performance drops significantly on the previous tasks. This property greatly limits the application of the semantic segmentation models to the practical world. To solve this problem, an incremental learning method: Combination of Old Prediction and Modified Label (COPML) is developed in this dissertation project. The proposed method utilizes the prediction results of the old model and the modified labels of the new task to create pseudo labels which are close to the ground truth. By using these pseudo labels for training, the model is expected to preserve the knowledge of old tasks. In addition, other incremental learning technologies - knowledge distillation, replay and parameter freezing are also applied to the proposed method to further assist the model in overcoming catastrophic forgetting. The effectiveness of the proposed method is validated on two semantic segmentation models: Unet and Deeplab3 in Pascal-VOC 2012 dataset and a self-made dataset which contains images taken in NTU and its surroundings. The experimental results demonstrate that COPML enables the model to maintain most of the old knowledge while obtaining an excellent performance on a new task. |
| first_indexed | 2025-02-19T03:09:47Z |
| format | Thesis-Master by Coursework |
| id | ntu-10356/157338 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2025-02-19T03:09:47Z |
| publishDate | 2022 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1573382023-07-04T17:50:31Z Incremental learning technologies for semantic segmentation Yang, Yizhuo Xie Lihua School of Electrical and Electronic Engineering ELHXIE@ntu.edu.sg Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Semantic segmentation models based on deep learning technologies have achieved remarkable results in recent years. However, many models encounter the problem of catastrophic forgetting, i.e. when the model is required to learn a new task without labels for old objects, its performance drops significantly on the previous tasks. This property greatly limits the application of the semantic segmentation models to the practical world. To solve this problem, an incremental learning method: Combination of Old Prediction and Modified Label (COPML) is developed in this dissertation project. The proposed method utilizes the prediction results of the old model and the modified labels of the new task to create pseudo labels which are close to the ground truth. By using these pseudo labels for training, the model is expected to preserve the knowledge of old tasks. In addition, other incremental learning technologies - knowledge distillation, replay and parameter freezing are also applied to the proposed method to further assist the model in overcoming catastrophic forgetting. The effectiveness of the proposed method is validated on two semantic segmentation models: Unet and Deeplab3 in Pascal-VOC 2012 dataset and a self-made dataset which contains images taken in NTU and its surroundings. The experimental results demonstrate that COPML enables the model to maintain most of the old knowledge while obtaining an excellent performance on a new task. Master of Science (Computer Control and Automation) 2022-05-30T13:45:00Z 2022-05-30T13:45:00Z 2022 Thesis-Master by Coursework Yang, Y. (2022). Incremental learning technologies for semantic segmentation. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/157338 https://hdl.handle.net/10356/157338 en application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Yang, Yizhuo Incremental learning technologies for semantic segmentation |
| title | Incremental learning technologies for semantic segmentation |
| title_full | Incremental learning technologies for semantic segmentation |
| title_fullStr | Incremental learning technologies for semantic segmentation |
| title_full_unstemmed | Incremental learning technologies for semantic segmentation |
| title_short | Incremental learning technologies for semantic segmentation |
| title_sort | incremental learning technologies for semantic segmentation |
| topic | Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence |
| url | https://hdl.handle.net/10356/157338 |
| work_keys_str_mv | AT yangyizhuo incrementallearningtechnologiesforsemanticsegmentation |