Mutual Information Based Learning Rate Decay for Stochastic Gradient Descent Training of Deep Neural Networks
This paper demonstrates a novel approach to training deep neural networks using a Mutual Information (MI)-driven, decaying Learning Rate (LR), Stochastic Gradient Descent (SGD) algorithm. MI between the output of the neural network and true outcomes is used to adaptively set the LR for the network,...
保存先:
| 第一著者: | |
|---|---|
| フォーマット: | Artigo |
| 言語: | Inglês |
| 出版事項: |
MDPI AG
2020-05-01
|
| シリーズ: | Entropy |
| 主題: | |
| オンライン･アクセス: | https://www.mdpi.com/1099-4300/22/5/560 |
| タグ: |
タグなし, このレコードへの初めてのタグを付けませんか!
|