Representation

• Word Embedding

  Dense vector representation of a word in low-dimensional space, capturing semantic and syntactic relationships.

• Sentence Embedding

  Dense vector representation of a sentence or passage, aggregating token information into a single low-dimensional vector that preserves semantic meaning.

• Matryoshka Representation Learning

  Training method where prefixes of a vector are also useful embeddings; enables efficient storage and search at multiple granularities. Abbreviated MRL.