Probability
-
Language Model
Probability distribution over sequences of tokens; predicts next token given context. Foundation of NLP from n-grams to large language models.
Probability distribution over sequences of tokens; predicts next token given context. Foundation of NLP from n-grams to large language models.