Automatic Differentiation

Use this note to explain computation graphs, local derivative rules, reverse-mode traversal, gradient accumulation, and the relationship between autodiff and backpropagation.