Layer Normalization

Zero Centering

Process of subtracting the mean of activations in layer normalization to center data around zero, facilitating gradient optimization.

← Geri