Neural Networks
Activation Function
A mathematical function that determines the output of a neural network layer.
Expanded definition
Activation functions introduce non-linearities into the neural network, allowing it to learn complex patterns. Common activation functions include ReLU, sigmoid, and tanh. They help the model to make decisions and classifications based on input data.
Related terms
Explore adjacent ideas in the knowledge graph.