Vision Transformers (ViT)

Computational Complexity O(n²)

Quadratic complexity of self-attention with respect to the number of patches constituting the main limitation of Vision Transformers.

← Geri