Concept graph
Generative AI and LLM glossary
Clear AI definitions with practical context, examples, and links to related models, tools, and concepts.
Deep Learning
Attention
Attention is the mechanism that lets a transformer weigh which other tokens matter when computing the next representation.
Neural Networks
Attention Mechanism
A technique that allows models to focus on specific parts of the input data when making predictions.
Machine Learning
graph-attention-network
A neural network architecture that employs attention mechanisms to process graph-structured data.
Inference
KV cache
The KV cache stores attention keys and values from already processed tokens so the model does not recompute the whole prefix each step.
Machine Learning
scalable-dot-product-attention
An efficient variant of attention mechanism designed for large datasets.
Deep Learning
Transformer
A transformer is a neural architecture that uses attention to relate tokens in a sequence; most frontier LLMs are transformers.