TabNet

GLU (Gated Linear Unit)

Activation function used in TabNet's Feature Transformer, which enables information flow control by multiplying a linear projection by a sigmoid gate, improving the network's ability to model complex relationships.

← Wstecz