Gradient-based Neural Architecture Search

Approximate gradient

Technique used to approximate computationally expensive second-order gradients in bi-level optimization, usually by ignoring certain terms to improve efficiency.

← Geri