Self-Attention

Masked Self-Attention

Self-attention with masking of future positions to prevent elements from seeing subsequent information, essential in text generation tasks.

← 뒤로