Git Product home page Git Product logo

deep_learning_object_detection's Introduction

deep learning object detection

A paper list of object detection using deep learning. I wrote this page with reference to this survey paper and searching and searching..

Last updated: 2019/07/31

Update log

2018/9/18 - update all of recent papers and make some diagram about history of object detection using deep learning. 2018/9/26 - update codes of papers. (official and unofficial)
2018/october - update 5 papers and performance table.
2018/november - update 9 papers.
2018/december - update 8 papers and and performance table and add new diagram(2019 version!!).
2019/january - update 4 papers and and add commonly used datasets.
2019/february - update 3 papers.
2019/march - update figure and code links.
2019/april - remove author's names and update ICLR 2019 & CVPR 2019 papers.
2019/may - update CVPR 2019 papers.
2019/june - update CVPR 2019 papers and dataset paper.
2019/july - update BMVC 2019 papers and some of ICCV 2019 papers.

Table of Contents

Paper list from 2014 to now(2019)

The part highlighted with red characters means papers that i think "must-read". However, it is my personal opinion and other papers are important too, so I recommend to read them if you have time.

Performance table

FPS(Speed) index is related to the hardware spec(e.g. CPU, GPU, RAM, etc), so it is hard to make an equal comparison. The solution is to measure the performance of all models on hardware with equivalent specifications, but it is very difficult and time consuming.

Detector VOC07 (mAP@IoU=0.5) VOC12 (mAP@IoU=0.5) COCO (mAP@IoU=0.5:0.95) Published In
R-CNN 58.5 - - CVPR'14
SPP-Net 59.2 - - ECCV'14
MR-CNN 78.2 (07+12) 73.9 (07+12) - ICCV'15
Fast R-CNN 70.0 (07+12) 68.4 (07++12) 19.7 ICCV'15
Faster R-CNN 73.2 (07+12) 70.4 (07++12) 21.9 NIPS'15
YOLO v1 66.4 (07+12) 57.9 (07++12) - CVPR'16
G-CNN 66.8 66.4 (07+12) - CVPR'16
AZNet 70.4 - 22.3 CVPR'16
ION 80.1 77.9 33.1 CVPR'16
HyperNet 76.3 (07+12) 71.4 (07++12) - CVPR'16
OHEM 78.9 (07+12) 76.3 (07++12) 22.4 CVPR'16
MPN - - 33.2 BMVC'16
SSD 76.8 (07+12) 74.9 (07++12) 31.2 ECCV'16
GBDNet 77.2 (07+12) - 27.0 ECCV'16
CPF 76.4 (07+12) 72.6 (07++12) - ECCV'16
R-FCN 79.5 (07+12) 77.6 (07++12) 29.9 NIPS'16
DeepID-Net 69.0 - - PAMI'16
NoC 71.6 (07+12) 68.8 (07+12) 27.2 TPAMI'16
DSSD 81.5 (07+12) 80.0 (07++12) 33.2 arXiv'17
TDM - - 37.3 CVPR'17
FPN - - 36.2 CVPR'17
YOLO v2 78.6 (07+12) 73.4 (07++12) - CVPR'17
RON 77.6 (07+12) 75.4 (07++12) 27.4 CVPR'17
DeNet 77.1 (07+12) 73.9 (07++12) 33.8 ICCV'17
CoupleNet 82.7 (07+12) 80.4 (07++12) 34.4 ICCV'17
RetinaNet - - 39.1 ICCV'17
DSOD 77.7 (07+12) 76.3 (07++12) - ICCV'17
SMN 70.0 - - ICCV'17
Light-Head R-CNN - - 41.5 arXiv'17
YOLO v3 - - 33.0 arXiv'18
SIN 76.0 (07+12) 73.1 (07++12) 23.2 CVPR'18
STDN 80.9 (07+12) - - CVPR'18
RefineDet 83.8 (07+12) 83.5 (07++12) 41.8 CVPR'18
SNIP - - 45.7 CVPR'18
Relation-Network - - 32.5 CVPR'18
Cascade R-CNN - - 42.8 CVPR'18
MLKP 80.6 (07+12) 77.2 (07++12) 28.6 CVPR'18
Fitness-NMS - - 41.8 CVPR'18
RFBNet 82.2 (07+12) - - ECCV'18
CornerNet - - 42.1 ECCV'18
PFPNet 84.1 (07+12) 83.7 (07++12) 39.4 ECCV'18
Pelee 70.9 (07+12) - - NIPS'18
HKRM 78.8 (07+12) - 37.8 NIPS'18
M2Det - - 44.2 AAAI'19
R-DAD 81.2 (07++12) 82.0 (07++12) 43.1 AAAI'19

2014

2015

2016

2017

2018

2019

  • [M2Det] M2Det: A Single-Shot Object Detector based on Multi-Level Feature Pyramid Network | [AAAI' 19] |[pdf] [official code - pytorch]

  • [R-DAD] Object Detection based on Region Decomposition and Assembly | [AAAI' 19] |[pdf]

  • [CAMOU] CAMOU: Learning Physical Vehicle Camouflages to Adversarially Attack Detectors in the Wild | [ICLR' 19] |[pdf]

  • Feature Intertwiner for Object Detection | [ICLR' 19] |[pdf]

  • [GIoU] Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regression | [CVPR' 19] |[pdf]

  • Automatic adaptation of object detectors to new domains using self-training | [CVPR' 19] |[pdf]

  • [Libra R-CNN] Libra R-CNN: Balanced Learning for Object Detection | [CVPR' 19] |[pdf]

  • Feature Selective Anchor-Free Module for Single-Shot Object Detection | [CVPR' 19] |[pdf]

  • [ExtremeNet] Bottom-up Object Detection by Grouping Extreme and Center Points | [CVPR' 19] |[pdf] | [official code - pytorch]

  • [C-MIL] C-MIL: Continuation Multiple Instance Learning for Weakly Supervised Object Detection | [CVPR' 19] |[pdf] | [official code - torch]

  • [ScratchDet] ScratchDet: Training Single-Shot Object Detectors from Scratch | [CVPR' 19] |[pdf]

  • Bounding Box Regression with Uncertainty for Accurate Object Detection | [CVPR' 19] |[pdf] | [official code - caffe2]

  • Activity Driven Weakly Supervised Object Detection | [CVPR' 19] |[pdf]

  • Towards Accurate One-Stage Object Detection with AP-Loss | [CVPR' 19] |[pdf]

  • Strong-Weak Distribution Alignment for Adaptive Object Detection | [CVPR' 19] |[pdf] | [official code - pytorch]

  • [NAS-FPN] NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detection | [CVPR' 19] |[pdf]

  • [Adaptive NMS] Adaptive NMS: Refining Pedestrian Detection in a Crowd | [CVPR' 19] |[pdf]

  • Point in, Box out: Beyond Counting Persons in Crowds | [CVPR' 19] |[pdf]

  • Locating Objects Without Bounding Boxes | [CVPR' 19] |[pdf]

  • Sampling Techniques for Large-Scale Object Detection from Sparsely Annotated Objects | [CVPR' 19] |[pdf]

  • Towards Universal Object Detection by Domain Attention | [CVPR' 19] |[pdf]

  • Exploring the Bounds of the Utility of Context for Object Detection | [CVPR' 19] |[pdf]

  • What Object Should I Use? - Task Driven Object Detection | [CVPR' 19] |[pdf]

  • Dissimilarity Coefficient based Weakly Supervised Object Detection | [CVPR' 19] |[pdf]

  • Adapting Object Detectors via Selective Cross-Domain Alignment | [CVPR' 19] |[pdf]

  • Fully Quantized Network for Object Detection | [CVPR' 19] |[pdf]

  • Distilling Object Detectors with Fine-grained Feature Imitation | [CVPR' 19] |[pdf]

  • Multi-task Self-Supervised Object Detection via Recycling of Bounding Box Annotations | [CVPR' 19] |[pdf]

  • [Reasoning-RCNN] Reasoning-RCNN: Unifying Adaptive Global Reasoning into Large-scale Object Detection | [CVPR' 19] |[pdf]

  • Arbitrary Shape Scene Text Detection with Adaptive Text Region Representation | [CVPR' 19] |[pdf]

  • Assisted Excitation of Activations: A Learning Technique to Improve Object Detectors | [CVPR' 19] |[pdf]

  • Spatial-aware Graph Relation Network for Large-scale Object Detection | [CVPR' 19] |[pdf]

  • [MaxpoolNMS] MaxpoolNMS: Getting Rid of NMS Bottlenecks in Two-Stage Object Detectors | [CVPR' 19] |[pdf]

  • You reap what you sow: Generating High Precision Object Proposals for Weakly-supervised Object Detection | [CVPR' 19] |[pdf]

  • Object detection with location-aware deformable convolution and backward attention filtering | [CVPR' 19] |[pdf]

  • Diversify and Match: A Domain Adaptive Representation Learning Paradigm for Object Detection | [CVPR' 19] |[pdf]

  • [GFR] Improving Object Detection from Scratch via Gated Feature Reuse | [BMVC' 19] |[pdf] | [official code - pytorch]

  • [Cascade RetinaNet] Cascade RetinaNet: Maintaining Consistency for Single-Stage Object Detection | [BMVC' 19] |[pdf]

  • Soft Sampling for Robust Object Detection | [BMVC' 19] |[pdf]

  • Multi-adversarial Faster-RCNN for Unrestricted Object Detection | [ICCV' 19] |[pdf]

  • Towards Adversarially Robust Object Detection | [ICCV' 19] |[pdf]

  • [Cap2Det] Cap2Det: Learning to Amplify Weak Caption Supervision for Object Detection | [ICCV' 19] |[pdf]

  • [Gaussian YOLOv3] Gaussian YOLOv3: An Accurate and Fast Object Detector using Localization Uncertainty for Autonomous Driving | [ICCV' 19] |[pdf]

Dataset Papers

Statistics of commonly used object detection datasets. The Table came from this survey paper.

Challenge Object Classes Number of Images Number of Annotated Images
Train Val Test Train Val
PASCAL VOC Object Detection Challenge
VOC07 20 2,501 2,510 4,952 6,301 (7,844) 6,307 (7,818)
VOC08 20 2,111 2,221 4,133 5,082 (6,337) 5,281 (6,347)
VOC09 20 3,473 3,581 6,650 8,505 (9,760) 8,713 (9,779)
VOC10 20 4,998 5,105 9,637 11,577 (13,339) 11,797 (13,352)
VOC11 20 5,717 5,823 10,994 13,609 (15,774) 13,841 (15,787)
VOC12 20 5,717 5,823 10,991 13,609 (15,774) 13,841 (15,787)
ILSVRC Object Detection Challenge
ILSVRC13 200 395,909 20,121 40,152 345,854 55,502
ILSVRC14 200 456,567 20,121 40,152 478,807 55,502
ILSVRC15 200 456,567 20,121 51,294 478,807 55,502
ILSVRC16 200 456,567 20,121 60,000 478,807 55,502
ILSVRC17 200 456,567 20,121 65,500 478,807 55,502
MS COCO Object Detection Challenge
MS COCO15 80 82,783 40,504 81,434 604,907 291,875
MS COCO16 80 82,783 40,504 81,434 604,907 291,875
MS COCO17 80 118,287 5,000 40,670 860,001 36,781
MS COCO18 80 118,287 5,000 40,670 860,001 36,781
Open Images Object Detection Challenge
OID18 500 1,743,042 41,620 125,436 12,195,144 ―

The papers related to datasets used mainly in Object Detection are as follows.

  • [PASCAL VOC] The PASCAL Visual Object Classes (VOC) Challenge | [IJCV' 10] | [pdf]

  • [PASCAL VOC] The PASCAL Visual Object Classes Challenge: A Retrospective | [IJCV' 15] | [pdf] | [link]

  • [ImageNet] ImageNet: A Large-Scale Hierarchical Image Database| [CVPR' 09] | [pdf]

  • [ImageNet] ImageNet Large Scale Visual Recognition Challenge | [IJCV' 15] | [pdf] | [link]

  • [COCO] Microsoft COCO: Common Objects in Context | [ECCV' 14] | [pdf] | [link]

  • [Open Images] The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scale | [arXiv' 18] | [pdf] | [link]

  • [DOTA] DOTA: A Large-scale Dataset for Object Detection in Aerial Images | [CVPR' 18] | [pdf] | [link]

Contact & Feedback

If you have any suggestions about papers, feel free to mail me :)

deep_learning_object_detection's People

Contributors

dgmello avatar erjanmx avatar hoya012 avatar jasonnor avatar luxedo avatar rcdilorenzo avatar shujian2015 avatar weiyaowu-md avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.