Heterogeneous Knowledge Distillation Using Conceptual Learning

Recent advances in deep learning have led to the development of large, high-performing models that have been pretrained on massive datasets. However, employing these models in real-world services requires fast inference speed and low computational complexity. This has driven an interest in model com...

Full description

Bibliographic Details
Main Authors: Yerin Yu, Namgyu Kim
Format: Article
Language:English
Published: IEEE 2024-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10496688/