In 2006–2007, NVIDIA launched CUDA, a programming model for general-purpose GPUs. ML researchers soon found that training large nets fit GPU SIMD parallelism.
Later frameworks (Theano, cuDNN, TensorFlow, PyTorch) rode that stack. Cost per FLOP fell and model size grew.
Today chip geopolitics and NVIDIA’s roadmap are as much part of AI history as any architecture paper.