Positional Encoding

Reformer Locality Sensitive Hashing

Specialized technique in Reformer that uses LSH with positional encoding to reduce computational complexity of attention on very long sequences.

← Tillbaka