Additionally, the global receptive field in Transformer's attention leads to unnecessary computations for features with limited spatial extent in image sentiment analysis. In this paper we presents a ...

We leverage a triple attention-aided vision transformer (TrpViT) architecture, which uses a vision-centric approach within the transformer network to enhance global information acquisition. The TrpViT ...

TresResU-Net is an encoder-decoder based architecture built upon residual block and takes the advantage of transformer self-attention mechanism and dilated convolution. Experimental result on two ...

but does not suffer the drop in performance or limitation to only one input modality seen with other efficient Transformer-based approaches. BiXT is inspired by the Perceiver architectures but ...