Attention maps

Attention Head Importance

Quantitative evaluation of the contribution of each attention head in a multi-head model to the overall system performance.

← Geri