Also called: self-attention
The mechanism that lets a model weigh which earlier words matter most when producing the next one.
Why it mattersIt's the idea that made transformers work, and the reason models track context across long passages.
See also Transformer, Context Window