Enabling Large Batch Size Training for DNN Models Beyond the Memory Limit While Maintaining Performance
Recent deep learning models are difficult to train using a large batch size, because commodity machines may not have enough memory to accommodate both the model and a large data batch size. The batch size is one of the hyper-parameters used in the training model, and it is dependent on and is limite...
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Artigo |
| Sprache: | Inglês |
| Veröffentlicht: |
IEEE
2023-01-01
|
| Schriftenreihe: | IEEE Access |
| Schlagworte: | |
| Online-Zugang: | https://ieeexplore.ieee.org/document/10242106/ |
| Tags: |
Keine Tags, Fügen Sie das erste Tag hinzu!
|