Exploring Flatter Loss Landscape Surface via Sharpness-Aware Minimization with Linear Mode Connectivity
The Sharpness-Aware Minimization (SAM) optimizer connects flatness and generalization, suggesting that loss basins with lower sharpness are correlated with better generalization. However, SAM requires manually tuning the open ball radius, which complicates its practical application. To address this,...
Guardat en:
| Autors principals: | , , , , , |
|---|---|
| Format: | Artigo |
| Idioma: | Inglês |
| Publicat: |
MDPI AG
2025-04-01
|
| Col·lecció: | Mathematics |
| Matèries: | |
| Accés en línia: | https://www.mdpi.com/2227-7390/13/8/1259 |
| Etiquetes: |
Sense etiquetes, Sigues el primer a etiquetar aquest registre!
|