Weighting

• Attention Mechanism

  Weighted aggregation of context vectors, allowing models to focus on relevant information. Fundamental to transformers and modern NLP.

• TF-IDF

  TF-IDF (term frequency–inverse document frequency) is a numerical statistic that reflects how important a word is to a document relative to a corpus, used as a relevance signal in search ranking.