Skip to content

Backpropagation

1986

Compute the gradient of the loss with respect to every weight by the chain rule, layer by layer. Werbos 1974, Rumelhart, Hinton and Williams 1986. The algorithm that trains all deep networks.

Sources: AI4U editorial.