Concept graph
Generative AI and LLM glossary
Clear AI definitions with practical context, examples, and links to related models, tools, and concepts.
Training Techniques
Backpropagation
An algorithm used for training neural networks by calculating gradients of the loss function.
Machine Learning
Cross-Entropy Loss
A loss function commonly used in classification tasks to measure the difference between predicted and actual distributions.
Optimization
Gradient Descent
An optimization algorithm used to minimize the loss function in machine learning.
Evaluation Metrics
Loss Function
A method of evaluating how well a specific algorithm models the given data.
Modeling
Regularization
A technique used to prevent overfitting by adding a penalty to the loss function.