Another re-recorded video: the vectorized version of backpropagation:
This one illustrates something that I think a lot of lectures get wrong or skip over: the Jacobian perspective is pretty useless in robustly working out vectorized backprop.
If you try to apply a matrix calculus chain rule, we get factors like these—the derivative of a vector with respect to a matrix—which no matrix calculus will help you with.
