Concept graph
Generative AI and LLM glossary
Clear AI definitions with practical context, examples, and links to related models, tools, and concepts.
Data Preparation
Labeling
The process of assigning a specific tag or category to data.
Models
Large language model
A large language model, or LLM, is a neural text model trained on large corpora to predict, generate, transform, and reason over language and code.
Statistical Models
Latent Variable Model
A statistical model that assumes the existence of unobserved variables that influence observed data.
Model Training
Learning Rate
The learning rate is a hyperparameter that controls how much to change the model weights in response to the estimated error each time the model weights are updated.
Evaluation
LLM evaluation
LLM evaluation measures whether a model or AI workflow is accurate, useful, safe, reliable, and cost-effective for a target task.
Inference
logit
A logit is an unnormalized score for a vocabulary item before softmax turns it into a probability.
Model Capabilities
Long Context
Long context is an LLM's ability to accept a large token window containing prompts, documents, conversation history, tool results, and generated output.
Evaluation Metrics
Loss Function
A method of evaluating how well a specific algorithm models the given data.