Gradient-based Hyperparameter Optimization

Hypergradient

Gradient of the loss function with respect to hyperparameters, computed using automatic differentiation through the model parameter optimization process.

← Geri