8 min readNeural Networks
Backpropagation and Gradient Descent
How a neural network learns: the loss as a function of weights, gradient descent, and backpropagation as the chain rule applied backwards, with every partial derivative of a small network computed by hand and checked against autograd.
Deep LearningOptimizationMathematics