The Geometry of Concepts: Sparse Autoencoder Feature Structure
Sparse autoencoders have recently produced dictionaries of high-dimensional vectors corresponding to the universe of concepts represented by large language models. We find that this concept universe has interesting structure at three levels: (1) The “atomic” small-scale structure contains “crystals”...
-д хадгалсан:
| Үндсэн зохиолчид: | , , , , , |
|---|---|
| Формат: | Artigo |
| Хэл сонгох: | Inglês |
| Хэвлэсэн: |
MDPI AG
2025-03-01
|
| Цуврал: | Entropy |
| Нөхцлүүд: | |
| Онлайн хандалт: | https://www.mdpi.com/1099-4300/27/4/344 |
| Шошгууд: |
Шошго байхгүй, Энэхүү баримтыг шошголох эхний хүн болох!
|