Ensemble Learning of Lightweight Deep Learning Models Using Knowledge Distillation for Image Classification

In recent years, deep learning models have been used successfully in almost every field including both industry and academia, especially for computer vision tasks. However, these models are huge in size, with millions (and billions) of parameters, and thus cannot be deployed on the systems and devic...

Full description

Bibliographic Details
Main Authors: Jaeyong Kang, Jeonghwan Gwak
Format: Article
Language:English
Published: MDPI AG 2020-09-01
Series:Mathematics
Subjects:
Online Access:https://www.mdpi.com/2227-7390/8/10/1652