Positional Encoding

Learned Positional Bias

Directly learned bias parameters added to attention scores based on relative positions, efficient alternative to full positional embeddings.

← Quay lại