A survey on knowledge distillation: Recent advancements

Deep learning has achieved notable success across academia, medicine, and industry. Its ability to identify complex patterns in large-scale data and to manage millions of parameters has made it highly advantageous. However, deploying deep learning models presents a significant challenge due to their...

Full description

Bibliographic Details
Main Authors: Amir Moslemi, Anna Briskina, Zubeka Dang, Jason Li
Format: Article
Language:English
Published: Elsevier 2024-12-01
Series:Machine Learning with Applications
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2666827024000811