Hierarchical Attention

Pyramid Attention Module

Specific module integrating an attention pyramid with progressive reduction rates for computational efficiency. Optimizes the performance/cost ratio in vision-transformer models.

← Zurück