Attention Masks

Triangular Causal Mask

Triangular matrix structure where elements above the diagonal are masked, creating strict temporal dependency in transformer models for sequential tasks.

← 뒤로