Mechanism

• Attention Mechanism

  Weighted aggregation of context vectors, allowing models to focus on relevant information. Fundamental to transformers and modern NLP.