Stochastic Gradient Descent (SGD)

Mini-batch Gradient Descent

Variant of SGD that uses a small subset of data (batch) to compute the gradient at each iteration, offering a compromise between pure SGD and batch gradient descent.

← Terug