Autocorrelation Matrix Knowledge Distillation: A Task-Specific Distillation Method for BERT Models
Pre-trained language models perform well in various natural language processing tasks. However, their large number of parameters poses significant challenges for edge devices with limited resources, greatly limiting their application in practical deployment. This paper introduces a simple and effici...
Guardat en:
| Autors principals: | , , , |
|---|---|
| Format: | Artigo |
| Idioma: | Inglês |
| Publicat: |
MDPI AG
2024-10-01
|
| Col·lecció: | Applied Sciences |
| Matèries: | |
| Accés en línia: | https://www.mdpi.com/2076-3417/14/20/9180 |
| Etiquetes: |
Sense etiquetes, Sigues el primer a etiquetar aquest registre!
|