AlexNet: ImageNet Classification with Deep Convolutional Neural Networks
AlexNet won ImageNet 2012 by a wide margin with GPU-trained deep convolutions, ReLU and dropout — the result that started the deep learning era.
8 steps · about 57 min · 2012–2023
How deep networks took over image understanding: the convolutions that started it, residual connections that made depth trainable, the transformer and contrastive turns, real-time detection, segmentation and neural scene representations.
Prefer to jump around? Each step is a standalone report with its own citations, figures and FAQ.
AlexNet won ImageNet 2012 by a wide margin with GPU-trained deep convolutions, ReLU and dropout — the result that started the deep learning era.
An AI-generated review of ResNet, the 2015 architecture that used skip connections to train networks hundreds of layers deep and became the default backbone.
An AI-generated review of YOLO, the 2015 detector that framed object detection as a single regression problem and made real-time detection possible on a GPU.
U-Net's symmetric encoder-decoder with skip connections became the standard for pixel-level prediction, from biomedical imaging to diffusion models.
The Vision Transformer applied a plain transformer to image patches and matched CNNs at scale — proving convolutions were optional for recognition.
An AI-generated review of CLIP, the contrastive vision-language model that made zero-shot image classification and text-guided image understanding practical.
An AI-generated review of NeRF, the 2020 method that represents a 3D scene as a neural field and renders photorealistic novel views from sparse input photos.
How the Segment Anything project reframed segmentation as a promptable task and released a 1-billion-mask dataset that made zero-shot segmentation practical.