Attention Head Analysis

Syntactic Role

Type of relationship, such as subject-verb binding or dependency between a noun and its adjective, that a specialized attention head can learn to detect and model.

← Indietro