Adaptive Distributed Parallel Training Method for a Deep Learning Model Based on Dynamic Critical Paths of DAG

Adaptive Distributed Parallel Training Method for a Deep Learning Model Based on Dynamic Critical Paths of DAG

AI provides a new method for massive simulated data calculations in molecular dynamics, materials, and other scientific computing fields. However, the complex structures and large-scale parameters of neural network models make them difficult to develop and train. The automatic parallel technology ba...

Full description

Bibliographic Details
Main Authors: Yan Zeng, Wei Wang, Yong Ding, Jilin Zhang, Yongjian Ren, Guangzheng Yi
Format: Article
Language:English
Published: MDPI AG 2022-12-01
Series:Mathematics
Subjects:
deep learning
model parallel
auto-parallel
dynamic critical path
DAG
Online Access:https://www.mdpi.com/2227-7390/10/24/4788

Internet

https://www.mdpi.com/2227-7390/10/24/4788

Similar Items