Attention Mechanism

Query, Key, Value

Triple of fundamental vectors in attention: Query represents the current request, Key the available keys, and Value the values to retrieve.

← Kembali