Gradient-based Hyperparameter Optimization

Unrolled Optimization

Technique where parameter optimization steps are explicitly unrolled in the computation graph to allow backpropagation through the optimization process.

← Geri