Modular Dynamic Neural Network: A Continual Learning Architecture

Modular Dynamic Neural Network: A Continual Learning Architecture

Learning to recognize a new object after having learned to recognize other objects may be a simple task for a human, but not for machines. The present go-to approaches for teaching a machine to recognize a set of objects are based on the use of deep neural networks (DNN). So, intuitively, the soluti...

Full description

Bibliographic Details
Main Authors:	Daniel Turner, Pedro J. S. Cardoso, João M. F. Rodrigues
Format:	Article
Language:	English
Published:	MDPI AG 2021-12-01
Series:	Applied Sciences
Subjects:	continual learning neural networks catastrophic forgetting object recognition
Online Access:	https://www.mdpi.com/2076-3417/11/24/12078

Similar Items

Task-Similarity Guided Progressive Deep Neural Network and Its Learning
by: WU Chu, WANG Shitong
Published: (2023-05-01)

Controlled Forgetting: Targeted Stimulation and Dopaminergic Plasticity Modulation for Unsupervised Lifelong Learning in Spiking Neural Networks
by: Jason M. Allred, et al.
Published: (2020-01-01)

A Continual Learning Algorithm Based on Orthogonal Gradient Descent Beyond Neural Tangent Kernel Regime
by: Da Eun Lee, et al.
Published: (2023-01-01)

Detecting Changes and Avoiding Catastrophic Forgetting in Dynamic Partially Observable Environments
by: Jeffery Dick, et al.
Published: (2020-12-01)

Incremental Learning for Dermatological Imaging Modality Classification
by: Ana C. Morgado, et al.
Published: (2021-09-01)

Lifelong Learning of Spatiotemporal Representations With Dual-Memory Recurrent Self-Organization
by: German I. Parisi, et al.
Published: (2018-11-01)

Continual Learning Objective for Analyzing Complex Knowledge Representations
by: Asad Mansoor Khan, et al.
Published: (2022-02-01)

Analysis of Continual Learning Models for Intrusion Detection System
by: Sai Prasath, et al.
Published: (2022-01-01)

Can sleep protect memories from catastrophic forgetting?
by: Oscar C González, et al.
Published: (2020-08-01)

Unified Probabilistic Deep Continual Learning through Generative Replay and Open Set Recognition
by: Martin Mundt, et al.
Published: (2022-03-01)

Online Continual Learning in Acoustic Scene Classification: An Empirical Study
by: Donghee Ha, et al.
Published: (2023-08-01)

SPACE: Structured Compression and Sharing of Representational Space for Continual Learning
by: Gobinda Saha, et al.
Published: (2021-01-01)

Human Skeleton Action Recognition Algorithm Based on Dynamic Topological Graph
by: XIE Yu, YANG Rui-ling, LIU Gong-xu, LI De-yu, WANG Wen-jian
Published: (2022-02-01)

Remembering for the right reasons: Explanations reduce catastrophic forgetting
by: Sayna Ebrahimi, et al.
Published: (2021-12-01)

Progressive Convolutional Neural Network for Incremental Learning
by: Zahid Ali Siddiqui, et al.
Published: (2021-08-01)

Catastrophic Forgetting in Deep Graph Networks: A Graph Classification Benchmark
by: Antonio Carta, et al.
Published: (2022-02-01)

Continual Learning With Speculative Backpropagation and Activation History
by: Sangwoo Park, et al.
Published: (2022-01-01)

Stabilizing Elastic Weight Consolidation Method in Practical ML Tasks and Using Weight Importance’s for Neural Network Pruning
by: Alexey Kutalev, et al.
Published: (2021-06-01)

A divided and prioritized experience replay approach for streaming regression
by: Mikkel Leite Arnø, et al.
Published: (2021-01-01)

Natural Way to Overcome Catastrophic Forgetting in Neural Networks
by: Alexey Kutalev
Published: (2020-09-01)

CLFM: Few-Shot Object Detection via Low-Resource Contrastive Learning and Fisher Matrix Updating for Overcoming Catastrophic Forgetting
by: Meng Wang, et al.
Published: (2022-01-01)

iKnight–Guarding IoT Infrastructure Using Generative Adversarial Networks
by: Santosh Nukavarapu, et al.
Published: (2022-01-01)

Lifelong Adaptive Machine Learning for Sensor-Based Human Activity Recognition Using Prototypical Networks
by: Rebecca Adaimi, et al.
Published: (2022-09-01)

Brain-Inspired Continual Learning: Robust Feature Distillation and Re-Consolidation for Class Incremental Learning
by: Hikmat Khan, et al.
Published: (2024-01-01)

A Class-Incremental Learning Method Based on Preserving the Learned Feature Space for EEG-Based Emotion Recognition
by: Magdiel Jiménez-Guarneros, et al.
Published: (2022-02-01)

An Appraisal of Incremental Learning Methods
by: Yong Luo, et al.
Published: (2020-10-01)

Unsupervised Learning to Overcome Catastrophic Forgetting in Neural Networks
by: Irene Munoz-Martin, et al.
Published: (2019-01-01)

Constructing a Large-Scale Landslide Database Across Heterogeneous Environments Using Task-Specific Model Updates
by: Savinay Nagendra, et al.
Published: (2022-01-01)

Incremental Learning in Deep Convolutional Neural Networks Using Partial Network Sharing
by: Syed Shakib Sarwar, et al.
Published: (2020-01-01)

Few-shot object detection on aerial imagery via deep metric learning and knowledge inheritance
by: Wu-zhou Li, et al.
Published: (2023-08-01)

Memory Protection Generative Adversarial Network (MPGAN): A Framework to Overcome the Forgetting of GANs Using Parameter Regularization Methods
by: Yifan Chang, et al.
Published: (2020-01-01)

The Stability-Plasticity Dilemma: Investigating the Continuum from Catastrophic Forgetting to Age-Limited Learning Effects
by: Martial eMermillod, et al.
Published: (2013-08-01)

Incremental Object Detection Method Based on Border Distance Measurement
by: LIU Dong-mei, XU Yang, WU Ze-bin, LIU Qian, SONG Bin, WEI Zhi-hui
Published: (2022-08-01)

Theory of Intelligence with Forgetting: Mathematical Theorems Explaining Human Universal Forgetting using “Forgetting Neural Networks”
by: Cano-Córdoba, Felipe, et al.
Published: (2018)

Slingshot: Globally Favorable Local Updates for Federated Learning
by: Jialiang Liu, et al.
Published: (2024-01-01)

A Survey of Incremental Deep Learning for Defect Detection in Manufacturing
by: Reenu Mohandas, et al.
Published: (2024-01-01)

Self-Organizing Multiple Readouts for Reservoir Computing
by: Yuichiro Tanaka, et al.
Published: (2023-01-01)

Combining Accuracy and Plasticity in Convolutional Neural Networks Based on Resistive Memory Arrays for Autonomous Learning
by: Stefano Bianchi, et al.
Published: (2021-01-01)

Class-Incremental Learning Based on Anomaly Detection
by: Lijuan Zhang, et al.
Published: (2023-01-01)

Robust Object Detection Against Multi-Type Corruption Without Catastrophic Forgetting During Adversarial Training Under Harsh Autonomous-Driving Environments
by: Youngjun Kim, et al.
Published: (2023-01-01)