Generative

• Language Model

  Probability distribution over sequences of tokens; predicts next token given context. Foundation of NLP from n-grams to large language models.

• GPT

  Generative Pre-trained Transformer; autoregressive decoder-only model for text generation and language understanding, published by OpenAI from 2018 onwards.