DILS: depth incremental learning strategy

There exist various methods for transferring knowledge between neural networks, such as parameter transfer, feature sharing, and knowledge distillation. However, these methods are typically applied when transferring knowledge between networks of equal size or from larger networks to smaller ones. Cu...

Full description

Bibliographic Details
Main Authors: Yanmei Wang, Zhi Han, Siquan Yu, Shaojie Zhang, Baichen Liu, Huijie Fan
Format: Article
Language:English
Published: Frontiers Media S.A. 2024-01-01
Series:Frontiers in Neurorobotics
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fnbot.2023.1337130/full