AI glossary
What is Top-p?
A sampling method that picks only from the smallest set of tokens whose probabilities add up to p.
With top_p = 0.9, the model ignores the long tail of unlikely tokens. Providers generally recommend tuning temperature or top_p, not both.