QR code

WMSA–WBS: Efficient Wave Multi-Head Self-Attention with Wavelet Bottleneck

The critical component of the vision transformer (ViT) architecture is multi-head self-attention (MSA), which enables the encoding of long-range dependencies and heterogeneous interactions. However, MSA has two significant limitations: its limited ability to capture local features and its high compu...

Volledige beschrijving

Bewaard in:
Hoofdauteurs: Xiangyang Li, Yafeng Li, Pan Fan, Xueya Zhang
Formaat: Artigo
Taal:Inglês
Gepubliceerd in: MDPI AG 2025-08-01
Reeks:Sensors
Onderwerpen:
vision transformer
self-attention
waveflow
wavelet transform
convolution neural network
Online toegang:https://www.mdpi.com/1424-8220/25/16/5046
Tags: Voeg label toe
Geen labels, Wees de eerste die dit record labelt!

Gelijkaardige items