Positional Encoding

xPOS (Scaling Positional Encoding)

Positional encoding method that uses exponential scaling to better capture long-range dependencies while preserving local position information.

← Tillbaka