Concept graph
Generative AI and LLM glossary
Clear AI definitions with practical context, examples, and links to related models, tools, and concepts.
Models
Large language model
A large language model, or LLM, is a neural text model trained on large corpora to predict, generate, transform, and reason over language and code.
Statistical Models
Latent Variable Model
A statistical model that assumes the existence of unobserved variables that influence observed data.
Model Training
Learning Rate
The learning rate is a hyperparameter that controls how much to change the model weights in response to the estimated error each time the model weights are updated.
Evaluation
LLM evaluation
LLM evaluation measures whether a model or AI workflow is accurate, useful, safe, reliable, and cost-effective for a target task.
Inference
logit
A logit is an unnormalized score for a vocabulary item before softmax turns it into a probability.
Model Capabilities
Long context
Long context is a product capability: a model or endpoint that accepts a much larger token window than a standard chat SKU.
Training
LoRA
LoRA, low-rank adaptation, fine-tunes a small set of adapter weights instead of updating every parameter of a base model.
Evaluation Metrics
Loss Function
A method of evaluating how well a specific algorithm models the given data.