Transfer Learning

Adapter Layers

Lightweight neural modules inserted between the layers of a pre-trained model to adapt it to new tasks. These additional layers are the only ones trained during fine-tuning, thus preserving the original knowledge of the model.

← Wstecz