LoRA (Low-Rank Adaptation)

Rank decomposition

Algebraic technique factoring a weight matrix W into W + BA where B and A are low-rank matrices. This decomposition forms the mathematical foundation of LoRA adaptation.

← Geri