Cross-Attention

Memory-Augmented Cross-Attention

Extension of cross-attention integrating external or persistent memory accessible via attention mechanisms. Allows storing and retrieving information beyond the immediate context window for long-range tasks.

← Wstecz