GENAIWIKI

Training

top-k

Top-k sampling restricts each step to the k highest-probability tokens.

Expanded definition

top-k shows up constantly when teams ship LLM features. Practically, it influences how you design prompts, evaluate quality, and reason about failure modes. Teams should document how top-k manifests in their stack—data handling, evaluation, and runtime guardrails—and revisit assumptions as models update.

Related terms

Explore adjacent ideas in the knowledge graph.