Słownik AI

📖

pojęcia

Contextual Embedding

Vector representations of words that change depending on the context in which the word appears, unlike static embeddings, thus capturing finer nuances of meaning.

📖

pojęcia

Token Weighting

A technique where input tokens are assigned different weights based on their relevance to the task, often used to handle padding tokens.