Tokenization efficiency of current foundational large language models for the Ukrainian language
Foundational large language models (LLMs) are deployed in multilingual environments across a range of general and narrow task domains. These models generate text token by token, making them slower and more computationally expensive for low-resource languages that are underrepresented in the tokenize...
Guardat en:
| Autors principals: | , |
|---|---|
| Format: | Artigo |
| Idioma: | Inglês |
| Publicat: |
Frontiers Media S.A.
2025-08-01
|
| Col·lecció: | Frontiers in Artificial Intelligence |
| Matèries: | |
| Accés en línia: | https://www.frontiersin.org/articles/10.3389/frai.2025.1538165/full |
| Etiquetes: |
Sense etiquetes, Sigues el primer a etiquetar aquest registre!
|