Shallow Univariate ReLU Networks as Splines: Initialization, Loss Surface, Hessian, and Gradient Flow Dynamics
Understanding the learning dynamics and inductive bias of neural networks (NNs) is hindered by the opacity of the relationship between NN parameters and the function represented. Partially, this is due to symmetries inherent within the NN parameterization, allowing multiple different parameter setti...
Na minha lista:
| Principais autores: | , , , , , , , |
|---|---|
| Format: | Artigo |
| Sprog: | Inglês |
| Udgivet: |
Frontiers Media S.A.
2022-05-01
|
| Serier: | Frontiers in Artificial Intelligence |
| Fag: | |
| Online adgang: | https://www.frontiersin.org/articles/10.3389/frai.2022.889981/full |
| Tags: |
Ingen Tags, Vær først til at tagge denne postø!
|
