Skip to main content

2 docs tagged with "gradient-descent"

View all tags

Derivatives - The Rate of Change

An introduction to derivatives, their definition, rules, and their crucial role in calculating the slope of the loss function, essential for optimization algorithms like Gradient Descent.

Gradients - The Direction of Steepest Ascent

Defining the Gradient vector, its mathematical composition from partial derivatives, its geometric meaning as the direction of maximum increase, and its role as the central mechanism for learning in Machine Learning.