Sentence Embedding Generation Framework Based on Kullback–Leibler Divergence Optimization and RoBERTa Knowledge Distillation

In natural language processing (NLP) tasks, computing semantic textual similarity (STS) is crucial for capturing nuanced semantic differences in text. Traditional word vector methods, such as Word2Vec and GloVe, as well as deep learning models like BERT, face limitations in handling context dependen...

ver descrição completa

Detalhes bibliográficos

Principais autores:	Jin Han, Liang Yang
Formato:	Artigo
Idioma:	Inglês
Publicado em:	MDPI AG 2024-12-01
coleção:	Mathematics
Assuntos:	semantic textual similarity (STS) Kullback–Leibler divergence (KLD) knowledge distillation feature selection similarity evaluation sentence embedding
Acesso em linha:	https://www.mdpi.com/2227-7390/12/24/3990
Tags:	Adicionar Tag Sem tags, seja o primeiro a adicionar uma tag!