Backpropagation

Backpropagation 1986: the algorithm that reopened deep networks

Rumelhart, Hinton, and Williams popularized gradient descent via error backpropagation in multilayer networks.