The Hessian Matrix
Understanding the Hessian matrix, second-order derivatives, and how the curvature of the loss surface impacts optimization and model stability.
Understanding the Hessian matrix, second-order derivatives, and how the curvature of the loss surface impacts optimization and model stability.