← Back to feed

CUDA (2007): GPUs for machine learning

NVIDIA launched CUDA, enabling general-purpose GPU programming; without it, modern deep learning would have been impractical.

CUDA (2007): GPUs for machine learning

In 2006–2007, NVIDIA launched CUDA, a programming model for general-purpose GPUs. ML researchers soon found that training large nets fit GPU SIMD parallelism.

Later frameworks (Theano, cuDNN, TensorFlow, PyTorch) rode that stack. Cost per FLOP fell and model size grew.

Today chip geopolitics and NVIDIA’s roadmap are as much part of AI history as any architecture paper.