Layer Normalization

Unit Variance

Standardization of activations to have unit variance in layer normalization, ensuring numerical stability and constant gradients across layers.

← Wstecz