Training
top-k
Top-k sampling restricts each step to the k highest-probability tokens.
Expanded definition
top-k shows up constantly when teams ship LLM features. Practically, it influences how you design prompts, evaluate quality, and reason about failure modes. Teams should document how top-k manifests in their stack—data handling, evaluation, and runtime guardrails—and revisit assumptions as models update.
Related terms
Explore adjacent ideas in the knowledge graph.