Progressive skeletonization: trimming more fat from a network at initialization
Recent studies have shown that skeletonization (pruning parameters) of networks at initialization provides all the practical benefits of sparsity both at inference and training time, while only marginally degrading their performance. However, we observe that beyond a certain level of sparsity (appro...
| المؤلفون الرئيسيون: | , , , , , |
|---|---|
| التنسيق: | Conference item |
| اللغة: | English |
| منشور في: |
OpenReview
2020
|