GENAIWIKI

Training

token

A token is the smallest unit a model consumes or generates; pricing and context limits are expressed in tokens.

Expanded definition

token shows up constantly when teams ship LLM features. Practically, it influences how you design prompts, evaluate quality, and reason about failure modes. Teams should document how token manifests in their stack—data handling, evaluation, and runtime guardrails—and revisit assumptions as models update.

Related terms

Explore adjacent ideas in the knowledge graph.