Preserving knowledge during learning

Humans and non-human animals live and learn in a continuous stream of information, and rarely experience catastrophic interference between currently and previously acquired knowledge. In contrast, artificial neural networks suffer from catastrophic forgetting and typically remain static once trained...