Scaled Dot-Product Attention

Query Projection

Linear transformation generating the Query matrix representing what each position seeks to find in the sequence.

← Geri