Incremental Object Detection Inspired by Memory Mechanisms in Brain
Incremental learning is key to bridging the enormous gap between artificial intelligence and human intelligence,mea-ning that agents can learn several tasks sequentially from a continuous stream of correlated data without forgetting,just as humans do.Object detection is one of the core tasks in the...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial office of Computer Science
2023-02-01
|
| Series: | Jisuanji kexue |
| Subjects: | |
| Online Access: | https://www.jsjkx.com/fileup/1002-137X/PDF/1002-137X-2023-50-2-267.pdf |
| _version_ | 1797845046150561792 |
|---|---|
| author | SHANG Di, LYU Yanfeng, QIAO Hong |
| author_facet | SHANG Di, LYU Yanfeng, QIAO Hong |
| author_sort | SHANG Di, LYU Yanfeng, QIAO Hong |
| collection | DOAJ |
| description | Incremental learning is key to bridging the enormous gap between artificial intelligence and human intelligence,mea-ning that agents can learn several tasks sequentially from a continuous stream of correlated data without forgetting,just as humans do.Object detection is one of the core tasks in the field of computer vision and the cornerstone of computer images understanding.Therefore,the incremental object detection has important research and practical significance.Although incremental learning has achieved good results in image classification,the research on incremental learning based on object detection is still in its infancy.This is because object detection is more complex than image classification,which needs to solve both classification and bounding box regression problems.Many researchers have made great efforts to solve this problem,but most of the work only focuses on how to retain previous learning,ignoring fast adaptability to new tasks,which is a critical requirement for incremental learning.Based on the memory mechanism of the brain,humans can constantly extract knowledge during learning,so as to learn new tasks better and faster without forgetting.Inspired by this,an incremental meta-learning method that integrates the codec memory replay mechanism is proposed.This method encodes,stores,decodes and replays the feature vectors of learned samples,so as to approximate the dynamic learning environment as a local stationary environment and avoid catastrophic forgetting.Besides,a double-loop online meta-learning strategy is designed,which can help model to extract common structures of tasks and improve generalization performance on new tasks encountered during learning.The model is respectively updated by SGD with multiple batches of old and new mixed data in the inner loop,and is meta-updated in the outer loop.We evaluate the proposed approach on three incremental object detection settings defined on PASCAL VOC and MS COCO datasets,where the proposed algorithm performs favorably well against state-of-the-art methods.It proves that it can help the model to resist forgetting better and have better generalization performance on new tasks.The proposed algorithm is gradient-based and model-agnostic,so it has strongadaptability and can be applied on more complex detection frameworks. |
| first_indexed | 2024-04-09T17:33:19Z |
| format | Article |
| id | doaj.art-26350213e3b04923aff7cc1f5d9a7bd5 |
| institution | Directory Open Access Journal |
| issn | 1002-137X |
| language | zho |
| last_indexed | 2024-04-09T17:33:19Z |
| publishDate | 2023-02-01 |
| publisher | Editorial office of Computer Science |
| record_format | Article |
| series | Jisuanji kexue |
| spelling | doaj.art-26350213e3b04923aff7cc1f5d9a7bd52023-04-18T02:33:17ZzhoEditorial office of Computer ScienceJisuanji kexue1002-137X2023-02-0150226727410.11896/jsjkx.220900212Incremental Object Detection Inspired by Memory Mechanisms in BrainSHANG Di, LYU Yanfeng, QIAO Hong0State Key Laboratory of Multimodal Artificial Intelligence System,Institute of Automation,Chinese Academy of Sciences,Beijing 100190,China;School of Artificial Intelligence,University of Chinese Academy of Sciences,Beijing 100049,China ;State Key Laboratory of Complex System Management and Control,Institute of Automation,Chinese Academy of Sciences,Beijing 100190,ChinaIncremental learning is key to bridging the enormous gap between artificial intelligence and human intelligence,mea-ning that agents can learn several tasks sequentially from a continuous stream of correlated data without forgetting,just as humans do.Object detection is one of the core tasks in the field of computer vision and the cornerstone of computer images understanding.Therefore,the incremental object detection has important research and practical significance.Although incremental learning has achieved good results in image classification,the research on incremental learning based on object detection is still in its infancy.This is because object detection is more complex than image classification,which needs to solve both classification and bounding box regression problems.Many researchers have made great efforts to solve this problem,but most of the work only focuses on how to retain previous learning,ignoring fast adaptability to new tasks,which is a critical requirement for incremental learning.Based on the memory mechanism of the brain,humans can constantly extract knowledge during learning,so as to learn new tasks better and faster without forgetting.Inspired by this,an incremental meta-learning method that integrates the codec memory replay mechanism is proposed.This method encodes,stores,decodes and replays the feature vectors of learned samples,so as to approximate the dynamic learning environment as a local stationary environment and avoid catastrophic forgetting.Besides,a double-loop online meta-learning strategy is designed,which can help model to extract common structures of tasks and improve generalization performance on new tasks encountered during learning.The model is respectively updated by SGD with multiple batches of old and new mixed data in the inner loop,and is meta-updated in the outer loop.We evaluate the proposed approach on three incremental object detection settings defined on PASCAL VOC and MS COCO datasets,where the proposed algorithm performs favorably well against state-of-the-art methods.It proves that it can help the model to resist forgetting better and have better generalization performance on new tasks.The proposed algorithm is gradient-based and model-agnostic,so it has strongadaptability and can be applied on more complex detection frameworks.https://www.jsjkx.com/fileup/1002-137X/PDF/1002-137X-2023-50-2-267.pdfincremental learning|object detection|brain inspiration|meta-learning|resistance to forgetting|generalization |
| spellingShingle | SHANG Di, LYU Yanfeng, QIAO Hong Incremental Object Detection Inspired by Memory Mechanisms in Brain Jisuanji kexue incremental learning|object detection|brain inspiration|meta-learning|resistance to forgetting|generalization |
| title | Incremental Object Detection Inspired by Memory Mechanisms in Brain |
| title_full | Incremental Object Detection Inspired by Memory Mechanisms in Brain |
| title_fullStr | Incremental Object Detection Inspired by Memory Mechanisms in Brain |
| title_full_unstemmed | Incremental Object Detection Inspired by Memory Mechanisms in Brain |
| title_short | Incremental Object Detection Inspired by Memory Mechanisms in Brain |
| title_sort | incremental object detection inspired by memory mechanisms in brain |
| topic | incremental learning|object detection|brain inspiration|meta-learning|resistance to forgetting|generalization |
| url | https://www.jsjkx.com/fileup/1002-137X/PDF/1002-137X-2023-50-2-267.pdf |
| work_keys_str_mv | AT shangdilyuyanfengqiaohong incrementalobjectdetectioninspiredbymemorymechanismsinbrain |