Xingjia Pan, Yuqiang Ren, Kekai Sheng, Weiming Dong, Haolei Yuan, Xiaowei Guo, Chongyang Ma, Changsheng Xu
Dynamic Refinement Network for Oriented and Densely Packed Object Detection[Paper Link]
Figure 1. Overall framework of our Dynamic Refinement Network. The backbone network is followed by two modules, i.e., feature selection module (FSM) and dynamic refinement heads (DRHs). FSM selects the most suitable features by adaptively adjusting receptive fields. The DRHs dynamically refine the predictions in an object-aware manner.
Figure 2. Some sample images from SKU110K. The images in top row are annotated with horizontal bounding boxes while the images in bottom row are with oriented bounding boxes.
To use SKU110K-R,
-
Download the original SKU110K data set from website and extract images
-
Generate SKU110K-R using our rotate augment script
python rotate_augment.py path/to/images
- Download the annotations for SKU110K-R from website
The annotation is in coco format.
we provide a variant of cocoapi for evaluation of rotated bounding boxes.
- Install cocoapi_ro(similar with cocoapi)
cd PythonAPi
make
- Replace pycocotools with pycocotools_ro
FROM
import pycocotools.coco as coco
from pycocotools.cocoeval import COCOeval
TO
import pycocotools_ro.coco as coco
from pycocotools_ro.cocoeval import COCOeval
- Update the evaluation code.
FROM
coco_eval = COCOeval(self.coco, coco_dets, "bbox")
TO
coco_eval = COCOeval(self.coco, coco_dets, "rbbox")
coco_eval.params.maxDets = [1, 10, 300]
we provide angle_nms for nms of rotated bounding box in post process.
from angle_nms.angle_soft_nms import angle_soft_nms
# Example
result_after_nms = angle_soft_nms(all_dets, Nt=0.5, method=1,threshold=0.05)
# all_dets: detection results
# Nt: iou threshold
# method: 1, linear soft nms; 2, gaussian soft nms; other, nms
# threshold: the minimum confidence valu to retain the detection bbox
- To use the rotation conv layer, you need to install dcn_v2 first,
# git clone -b pytorch_1.0.0 https://github.com/chengdazhi/Deformable-Convolution-V2-PyTorch.git
# mv Deformable-Convolution-V2-PyTorch DCNv2
cd DCNv2
./make.sh
- Then you need to modify the
import pathof dcnv2 in rotation_conv_utils.py.
from path\to\DCNv1.modules.modulated_deform_conv import ModulatedDeformConv
from path\to\DCNv2.functions.modulated_deform_conv_func import ModulatedDeformConvFunction
- We provide a simple example to use the rotation conv layer in test_rcl.py.
If you find this project useful for your research, please use the following BibTeX entry.
@article{pan2020dynamic,
title={Dynamic Refinement Network for Oriented and Densely Packed Object Detection},
author={Xingjia Pan and Yuqiang Ren and Kekai Sheng and Weiming Dong and Haolei Yuan and Xiaowei Guo and Chongyang Ma and Changsheng Xu},
booktitle={CVPR},
pages={1--8},
year={2020}
}
If you have any questions about our work, please do not hesitate to contact us by emails.
Xingjia Pan: [email protected]
Yuqiang Ren: [email protected]
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent