Topic

Learning Rate

2 episodes

Ep 686 Jul 16, 2026

Overview: Backpropagation

We finally define backpropagation the way we probably should’ve ages ago: as the backward bookkeeping step that tells a neural network which knobs caused the miss. We also connect it to loss, gradients, and gradient descent so the whole training loop actually clicks.

Training Backpropagation Neural Network Parameters Loss Function
Ep 677 Jul 15, 2026

Overview: Gradient Descent

We’re finally giving gradient descent the full couch-table treatment, because it’s hiding under half the AI stories we keep talking about. We get into the hill-climbing mental model, how loss, parameters, and backpropagation fit together, and why the whole thing is the boring engine that actually makes learning happen.

Training Gradient Descent Loss Function Neural Network Parameters