Multi-Modal Transformers

Modality Gap

Inherent structural and semantic difference between the representation spaces of different modalities, requiring specific alignment mechanisms in multi-modal models.

← Back