MicroBERT: Distilling MoE-Based Knowledge from BERT into a Lighter Model
Natural language-processing tasks have been improved greatly by large language models (LLMs). However, numerous parameters make their execution computationally expensive and difficult on resource-constrained devices. For this problem, as well as maintaining accuracy, some techniques such as distilla...
Na minha lista:
| Principais autores: | , , , , |
|---|---|
| Formato: | Artigo |
| Idioma: | Inglês |
| Publicado em: |
MDPI AG
2024-07-01
|
| coleção: | Applied Sciences |
| Assuntos: | |
| Acesso em linha: | https://www.mdpi.com/2076-3417/14/14/6171 |
| Tags: |
Sem tags, seja o primeiro a adicionar uma tag!
|