Słownik AI
Kompletny słownik sztucznej inteligencji
162
kategorie
2 032
podkategorie
23 060
pojęcia
pojęcia
Scaling Factor
Term √dk dividing the dot product in scaled attention to control gradient variance and prevent explosion/vanishing during training.
pojęcia
Dot-Product Similarity
Unnormalized cosine similarity measure calculated as dot product between vectors, serving as the basis for attention score computation.
pojęcia
Value Projection
Linear transformation applied to input embedding to generate the Value matrix used in weighted output computation.
pojęcia
Key Projection
Linear transformation creating the Key matrix from input embeddings, serving as indices for attentional search.
pojęcia
Query Projection
Linear transformation generating the Query matrix representing what each position seeks to find in the sequence.
🔍