Positional Encoding

Relative Positional Encoding

Advanced technique that encodes relative distances between tokens rather than their absolute positions, improving generalization to variable sequence lengths.

← Wstecz