Generative Self-Supervision

Bidirectional Encoder

Component using past and future context to encode tokens, crucial for masking tasks in generative self-supervision.

← Geri