Autoregressive Models

KV Cache

Optimization mechanism storing key-value states of previous tokens to accelerate sequential autoregressive generation.

← Quay lại