Encoders and Decoders

Token Embedding

Dense and continuous vector representation of each input token, the starting point of the transformer architecture before adding positional information.

← Tillbaka