Pipeline Parallelism With Elastic Averaging
To accelerate the training speed of massive DNN models on large-scale datasets, distributed training techniques, including data parallelism and model parallelism, have been extensively studied. In particular, pipeline parallelism, which is derived from model parallelism, has been attracting attentio...
Na minha lista:
| Principais autores: | , , |
|---|---|
| Format: | Artigo |
| Sprog: | Inglês |
| Udgivet: |
IEEE
2024-01-01
|
| Serier: | IEEE Access |
| Fag: | |
| Online adgang: | https://ieeexplore.ieee.org/document/10381706/ |
| Tags: |
Ingen Tags, Vær først til at tagge denne postø!
|