Transformer-based Generative Models

Attention Scale

Parameter controlling the distribution of attention in Transformer models, influencing the concentration or dispersion of contextual focus.

← Geri