Modified Step Size for Enhanced Stochastic Gradient Descent: Convergence and Experiments
This paper introduces a novel approach to enhance the performance of the stochastic gradient descent (SGD) algorithm by incorporating a modified decay step size based on $\frac{1}{\sqrt{t}}$. The proposed step size integrates a logarithmic term, leading to the selection of smaller values in the...
I tiakina i:
| Ngā kaituhi matua: | , |
|---|---|
| Hōputu: | Artigo |
| Reo: | Inglês |
| I whakaputaina: |
University of Kashan
2024-09-01
|
| Rangatū: | Mathematics Interdisciplinary Research |
| Ngā marau: | |
| Urunga tuihono: | https://mir.kashanu.ac.ir/article_114474_dde1b8da8db0067c294448415069d8b8.pdf |
| Ngā Tūtohu: |
Kāore He Tūtohu, Me noho koe te mea tuatahi ki te tūtohu i tēnei pūkete!
|