Superneurons: dynamic GPU memory management for training deep neural networks

© 2018 ACM. Going deeper and wider in neural architectures improves their accuracy, while the limited GPU DRAM places an undesired restriction on the network design domain. Deep Learning (DL) practitioners either need to change to less desired network architectures, or nontrivially dissect a network...

Full description

Bibliographic Details
Main Authors: Wang, Linnan, Ye, Jinmian, Zhao, Yiyang, Wu, Wei, Li, Ang, Song, Shuaiwen Leon, Xu, Zenglin, Kraska, Tim
Format: Article
Language:English
Published: Association for Computing Machinery (ACM) 2021
Online Access:https://hdl.handle.net/1721.1/132270