Contrastive Learning or Masked Autoencoder? Understanding and Improving Self-Supervised Knowledge Distillation
Lying at the intersection of self-supervised learning (SSL) and knowledge distillation (KD), Self-supervised KD (SSKD) differs from classical KD frameworks by assuming the teacher model is pretrained without labels. As SSKD relies on SSL-pretrained teachers, recent works have largely employed masked...
I tiakina i:
| Ngā kaituhi matua: | , , |
|---|---|
| Hōputu: | Artigo |
| Reo: | Inglês |
| I whakaputaina: |
IEEE
2026-01-01
|
| Rangatū: | IEEE Access |
| Ngā marau: | |
| Urunga tuihono: | https://ieeexplore.ieee.org/document/11417782/ |
| Ngā Tūtohu: |
Kāore He Tūtohu, Me noho koe te mea tuatahi ki te tūtohu i tēnei pūkete!
|