Papers

One paper, explained end to end: the idea, every equation, the numbers, and where it sits among the others.

DatePaperExplanationTags
Oct 2026 DETRs Beat YOLOs on Real-time Object Detection
Zhao, Lv, Xu, Wei, Wang, Dang, Liu, Chen, 2024
RT-DETR — DETRs Beat YOLOs, Encoder by Encoder · RT-DETR 1/5 Object detectionSet predictionEfficient attentionNon-maximum suppression
Oct 2026 RT-DETRv2: Improved Baseline with Bag-of-Freebies for Real-Time Detection Transformer
Lv, Zhao, Chang, Huang, Wang, Liu, 2024
RT-DETRv2 — A Bag of Freebies for the Decoder · RT-DETR 2/5 Object detectionEfficient attentionTraining recipesEdge deployment
Oct 2026 RT-DETRv3: Real-time End-to-End Object Detection with Hierarchical Dense Positive Supervision
Wang, Xia, Lv, Shi, 2024
RT-DETRv3 — More Positives Without Paying at Inference · RT-DETR 3/5 Object detectionSet predictionTraining recipes
Oct 2026 RT-DETRv4: Painlessly Furthering Real-Time Object Detection with Vision Foundation Models
Liao et al., 2025
RT-DETRv4 — Borrowing a Foundation Model's Eyes · RT-DETR 4/5 Object detectionKnowledge distillationTraining recipes
Oct 2026 RT-DETR-World: Transferring Rich LLM Semantics to Real-Time Open-Vocabulary Detection
Zhang et al., 2026
RT-DETR-World — Naming Any Object in Real Time · RT-DETR 5/5 Object detectionVision and languageContrastive learningKnowledge distillation
Oct 2026 Attention Is All You Need
Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser, Polosukhin, 2017
Attention Is All You Need — The Transformer, Block by Block · Transformers in Vision 3/12 TransformersPositional encodingSelf-attention
Oct 2026 End-to-End Object Detection with Transformers
Carion et al., 2020
DETR — Detection as Set Prediction, No Anchors and No NMS · Transformers in Vision 5/12 Object detectionSet predictionTransformers
Oct 2026 An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy et al., 2020
An Image Is Worth 16×16 Words — ViT, Patch by Patch · Transformers in Vision 6/12 Vision transformersImage classificationPretraining at scale
Oct 2026 Training data-efficient image transformers & distillation through attention
Touvron, Cord, Douze, Massa, Sablayrolles, Jégou, 2021
DeiT — Training a Vision Transformer on ImageNet Alone · Transformers in Vision 7/12 Vision transformersKnowledge distillationData augmentationTraining recipes
Oct 2026 Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu et al., 2021
Swin Transformer — Windows, Shifts and a Pyramid for Dense Prediction · Transformers in Vision 8/12 Vision transformersEfficient attentionFeature pyramids and necks
Oct 2026 Masked Autoencoders Are Scalable Vision Learners
He, Chen, Xie, Li, Dollár, Girshick, 2021
Masked Autoencoders — Hide 75 %, Encode the Rest · Transformers in Vision 10/12 Self-supervised learningVision transformers
Oct 2026 Learning Transferable Visual Models From Natural Language Supervision
Radford et al., 2021
CLIP — Learning Pictures From the Words Next to Them · Transformers in Vision 11/12 Vision and languageContrastive learningPretraining at scale
Aug 2021 In Defense of the Triplet Loss for Person Re-Identification
Hermans, Beyer, Leibe, 2017
In defense of triplet loss for person re-identification
by Deval Shah, on VisionWizard ↗
Re-identificationLoss functions
Oct 2020 Arbitrary Style Transfer with Style-Attentional Networks
Park, Lee, 2018
Insight on Style Attentional Networks (SANet) for Arbitrary Style Transfer
by dhwani mehta, on VisionWizard ↗
Generative modelsAttention modules
Aug 2020 Improving Language Understanding by Generative Pre-Training
Radford, Narasimhan, Salimans, Sutskever, 2018
OpenAI’s GPT — Part 1: Unveiling the GPT Model
by Yesha R Shastri, on VisionWizard ↗
Language modelsTransformersNatural language
Aug 2020 PAMTRI: Pose-Aware Multi-Task Learning for Vehicle Re-Identification Using Highly Randomized Synthetic Data
Tang et al., 2020
PAMTRI: Pose-Aware Multi-Task Learning for Vehicle Re-Identification Using Highly Randomized Synthetic Data
by Deval Shah, on VisionWizard ↗
Re-identificationKeypoints and poseTraffic analytics
Aug 2020 Fawkes: Protecting Privacy against Unauthorized Deep Learning Models
Shan et al., 2020
Protecting Privacy Using Fawkes Against Unauthorized Surveillance
by Vardan Agarwal, on VisionWizard ↗
FacesImage classification
Aug 2020 Instance Shadow Detection
Wang, Hu, Wang, Heng, Fu, 2019
LISA: An End-to-End Deep Framework for Instance Shadow Detection
by Devshree Patel, on VisionWizard ↗
SegmentationObject detection
Aug 2020 SpinalNet: Deep Neural Network with Gradual Input
Kabir et al., 2020
SpinalNet: Deep Neural Network with Gradual Input
by Ratnam Parikh, on VisionWizard ↗
Backbone designImage classification
Jul 2020 Dynamic Convolution: Attention over Convolution Kernels
Chen et al., 2019
Dynamic Convolution — An Exciting Innovation over Convolution Kernels from Microsoft Research
by Yesha R Shastri, on VisionWizard ↗
ConvolutionsAttention modulesEfficient networks
Jul 2020 Compounding the Performance Improvements of Assembled Techniques in a Convolutional Neural Network
Lee et al., 2020
Assembled CNN: Trick-o-Tweaks
by Mahima Modi, on VisionWizard ↗
Training recipesBackbone designData augmentation
Jul 2020 DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolution
Qiao, Chen, Yuille, 2020
DetectoRS — A Comprehensive Review Feature pyramids and necksConvolutionsObject detection
Jul 2020 SpineNet: Learning Scale-Permuted Backbone for Recognition and Localization
Du et al., 2019
SpineNet: An Unconventional Backbone Architecture from Google Brain
by Yesha R Shastri, on VisionWizard ↗
Backbone designObject detectionFeature pyramids and necks
Jul 2020 Automated detection of COVID-19 cases using deep neural networks with X-ray images
Ozturk, Talo, Yildirim, Baloglu, Yildirim, Acharya, 2020
DarkCovidNet: Automated detection of COVID-19 with X-ray images
by Ratnam Parikh, on VisionWizard ↗
Medical imagingImage classification
Jul 2020 PCL: Proposal Cluster Learning for Weakly Supervised Object Detection
Tang et al., 2018
Weakly Supervised Object Detection — An End to End Training Pipeline
by Yesha R Shastri, on VisionWizard ↗
Object detectionWeak supervision
Jul 2020 SCAN: Learning to Classify Images without Labels
Van Gansbeke, Vandenhende, Georgoulis, Proesmans, Van Gool, 2020
Self-Supervised Classification: Semantic Clustering by Adopting Nearest Neighbors
by Mahima Modi, on VisionWizard ↗
Self-supervised learningImage classification
Jul 2020 SNIPER: Efficient Multi-Scale Training
Singh, Najibi, Davis, 2018
SNIPER: Efficient Multi-Scale Training
by Devshree Patel, on VisionWizard ↗
Object detectionTraining recipesEfficient networks
Jul 2020 ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Lan et al., 2019
Is ALBERT short for BERT?
by Marzieh Mehdizadeh, on VisionWizard ↗
Language modelsTransformersNatural language
Jul 2020 Improving Semantic Segmentation via Video Propagation and Label Relaxation
Zhu et al., 2018
Video Semantic Segmentation -A Novel Approach from NVIDIA
by Yesha R Shastri, on VisionWizard ↗
SegmentationVideoData augmentation
Jun 2020 Unsupervised Translation of Programming Languages
Lachaux, Roziere, Chanussot, Lample, 2020
Facebook AI TransCoder
by Devshree Patel, on VisionWizard ↗
Natural languageLanguage modelsTransformers
Jun 2020 Visual Question Answering on 360{\deg} Images
Chou, Chao, Lai, Sun, Yang, 2020
Novel Visual Question Answering system on 360⁰ Images
by Ratnam Parikh, on VisionWizard ↗
Vision and languageNatural language
Jun 2020 MixConv: Mixed Depthwise Convolutional Kernels
Tan, Le, 2019
MixConv — Mixed Depthwise Convolutional Kernels from Google Brain ConvolutionsEfficient networks
Jun 2020 Designing Network Design Spaces
Radosavovic, Kosaraju, Girshick, He, Dollár, 2020
Simple, Powerful, and Fast— RegNet Architecture from Facebook AI Backbone designImage classification
Jun 2020 End-to-End Object Detection with Transformers
Carion et al., 2020
Revolutionary Object Detection Algorithm from Facebook AI
by Deval Shah, on VisionWizard ↗
Object detectionSet predictionTransformers
Jun 2020 YOLOv4: Optimal Speed and Accuracy of Object Detection
Bochkovskiy, Wang, Liao, 2020
YOLOv4 — Version 1: Bag of Freebies · YOLOv4 2/5
by Deval Shah, on VisionWizard ↗
Object detectionData augmentationTraining recipesLoss functions
Jun 2020 YOLOv4: Optimal Speed and Accuracy of Object Detection
Bochkovskiy, Wang, Liao, 2020
YOLOv4 — Version 3: Proposed Workflow · YOLOv4 4/5
by Deval Shah, on VisionWizard ↗
Object detectionBackbone designFeature pyramids and necks
Jun 2020 CBAM: Convolutional Block Attention Module
Woo, Park, Lee, Kweon, 2018
BAM: Bottleneck Attention Module
Park, Woo, Lee, Kweon, 2018
Understanding Attention Modules: CBAM and BAM — A Quick Read Attention modulesBackbone design
May 2020 Focal Loss for Dense Object Detection
Lin, Goyal, Girshick, He, Dollár, 2017
Understanding Focal Loss —A Quick Read Loss functionsClass imbalanceObject detection
May 2020 YOLOv4: Optimal Speed and Accuracy of Object Detection
Bochkovskiy, Wang, Liao, 2020
YOLOv4 — Version 4: Final Verdict · YOLOv4 5/5 Object detectionData augmentationTraining recipes
May 2020 Distance-IoU Loss: Faster and Better Learning for Bounding Box Regression
Zheng et al., 2019
Understanding DIoU Loss — A Quick Read
by Mahima Modi, on VisionWizard ↗
Loss functionsObject detectionNon-maximum suppression
May 2020 YOLOv4: Optimal Speed and Accuracy of Object Detection
Bochkovskiy, Wang, Liao, 2020
YOLOv4 — Version 2: Bag of Specials · YOLOv4 3/5 Object detectionAttention modulesActivation functionsFeature pyramids and necks
May 2020 EfficientDet: Scalable and Efficient Object Detection
Tan, Pang, Le, 2019
EfficientDet — A Comprehensive Review
by Kanan Vyas, on VisionWizard ↗
Object detectionFeature pyramids and necksEfficient networks
May 2020 YOLOv4: Optimal Speed and Accuracy of Object Detection
Bochkovskiy, Wang, Liao, 2020
YOLOv4 — Version 0: Introduction · YOLOv4 1/5 Object detectionBackbone design
May 2020 Objects as Points
Zhou, Wang, Krähenbühl, 2019
CenterNet: Objects as Points — A Comprehensive Guide Anchor-free detectionKeypoints and poseObject detection

44 papers, newest first.

Entries marked “on VisionWizard” are by other writers of the publication I ran; they open on Medium under the author's name. The VisionWizard tab lists all of them.

Series

Transformers in Vision · 12 parts, in order

  1. 1Attention Before Transformers — Score, Squash, Multiply
  2. 2Query, Key, Value — Dot-Product Attention from Scratch
  3. 3Attention Is All You Need — The Transformer, Block by Block
  4. 4Attention Meets Pixels — Windows, Axes and the First Fully Attentional Networks
  5. 5DETR — Detection as Set Prediction, No Anchors and No NMS
  6. 6An Image Is Worth 16×16 Words — ViT, Patch by Patch
  7. 7DeiT — Training a Vision Transformer on ImageNet Alone
  8. 8Swin Transformer — Windows, Shifts and a Pyramid for Dense Prediction
  9. 9Convolutions Strike Back — Was It the Attention or the Recipe?
  10. 10Masked Autoencoders — Hide 75 %, Encode the Rest
  11. 11CLIP — Learning Pictures From the Words Next to Them
  12. 12Vision Transformers Today — May 2022 to October 2026, Year by Year

YOLOv4 · 5 parts, in order

  1. 1YOLOv4 — Version 0: Introduction
  2. 2YOLOv4 — Version 1: Bag of Freebies
  3. 3YOLOv4 — Version 2: Bag of Specials
  4. 4YOLOv4 — Version 3: Proposed Workflow
  5. 5YOLOv4 — Version 4: Final Verdict

RT-DETR · 5 parts, in order

  1. 1RT-DETR — DETRs Beat YOLOs, Encoder by Encoder
  2. 2RT-DETRv2 — A Bag of Freebies for the Decoder
  3. 3RT-DETRv3 — More Positives Without Paying at Inference
  4. 4RT-DETRv4 — Borrowing a Foundation Model's Eyes
  5. 5RT-DETR-World — Naming Any Object in Real Time