Multiple-Stage Knowledge Distillation

Multiple-Stage Knowledge Distillation

Knowledge distillation (KD) is a method in which a teacher network guides the learning of a student network, thereby resulting in an improvement in the performance of the student network. Recent research in this area has concentrated on developing effective definitions of knowledge and efficient met...

Full description

Bibliographic Details
Main Authors: Chuanyun Xu, Nanlan Bai, Wenjian Gao, Tian Li, Mengwei Li, Gang Li, Yang Zhang
Format: Article
Language:English
Published: MDPI AG 2022-09-01
Series:Applied Sciences
Subjects:
knowledge distillation
multi-exit architecture
teacher–student network
ensemble learning
Online Access:https://www.mdpi.com/2076-3417/12/19/9453

Internet

https://www.mdpi.com/2076-3417/12/19/9453

Similar Items