Modified Step Size for Enhanced Stochastic Gradient Descent: Convergence and Experiments
This paper introduces a novel approach to enhance the performance of the stochastic gradient descent (SGD) algorithm by incorporating a modified decay step size based on $\frac{1}{\sqrt{t}}$. The proposed step size integrates a logarithmic term, leading to the selection of smaller values in the...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Artigo |
| Language: | Inglês |
| Published: |
University of Kashan
2024-09-01
|
| Series: | Mathematics Interdisciplinary Research |
| Subjects: | |
| Online Access: | https://mir.kashanu.ac.ir/article_114474_dde1b8da8db0067c294448415069d8b8.pdf |
| Tags: |
No Tags, Be the first to tag this record!
|