YZ Sözlüğü

📖

terimler

Parameter Regularization

Technique that adds a penalty to the loss function to limit modifications of important weights, foundation of EWC and other continual learning methods. This approach balances plasticity and stability in sequential learning.

📖

terimler

Elastic Weight Consolidation Online

Variant of EWC that updates the Fisher information matrix incrementally after each mini-batch, avoiding the need to store complete data from previous tasks. This approach is more suitable for real-time environments.

📖

terimler

Stability-Plasticity Dilemma

Fundamental problem in continual learning consisting of balancing the ability to learn new information (plasticity) with the necessity to preserve existing knowledge (stability). EWC and similar methods attempt to solve this dilemma.