← Back to feed

ResNet (2015): residual connections to go deeper

He et al. introduced residual networks that enabled training hundreds of layers and won ILSVRC 2015.

ResNet (2015): residual connections to go deeper

Kaiming He and colleagues (Microsoft Research) introduced Residual Networks: shortcuts that ease gradient flow and allow very deep nets without training collapse.

ResNet-50/101 became default vision backbones. Skip connections seeped into countless architectures, including NLP variants.

The paper illustrated a deep-learning pattern: an optimization/architecture trick can unlock a new model scale.