Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- PMID: 27295650
- DOI: 10.1109/TPAMI.2016.2577031
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Abstract
State-of-the-art object detection networks depend on region proposal algorithms to hypothesize object locations. Advances like SPPnet [1] and Fast R-CNN [2] have reduced the running time of these detection networks, exposing region proposal computation as a bottleneck. In this work, we introduce a Region Proposal Network (RPN) that shares full-image convolutional features with the detection network, thus enabling nearly cost-free region proposals. An RPN is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained end-to-end to generate high-quality region proposals, which are used by Fast R-CNN for detection. We further merge RPN and Fast R-CNN into a single network by sharing their convolutional features-using the recently popular terminology of neural networks with 'attention' mechanisms, the RPN component tells the unified network where to look. For the very deep VGG-16 model [3] , our detection system has a frame rate of 5 fps (including all steps) on a GPU, while achieving state-of-the-art object detection accuracy on PASCAL VOC 2007, 2012, and MS COCO datasets with only 300 proposals per image. In ILSVRC and COCO 2015 competitions, Faster R-CNN and RPN are the foundations of the 1st-place winning entries in several tracks. Code has been made publicly available.
Similar articles
-
An Enhanced Region Proposal Network for object detection using deep learning method.PLoS One. 2018 Sep 20;13(9):e0203897. doi: 10.1371/journal.pone.0203897. eCollection 2018. PLoS One. 2018. PMID: 30235238 Free PMC article.
-
Scale-Aware Pixelwise Object Proposal Networks.IEEE Trans Image Process. 2016 Oct;25(10):4525-39. doi: 10.1109/TIP.2016.2593342. Epub 2016 Jul 19. IEEE Trans Image Process. 2016. PMID: 27448357
-
Object Detection Networks on Convolutional Feature Maps.IEEE Trans Pattern Anal Mach Intell. 2017 Jul;39(7):1476-1481. doi: 10.1109/TPAMI.2016.2601099. Epub 2016 Aug 17. IEEE Trans Pattern Anal Mach Intell. 2017. PMID: 27541490
-
S-CNN: Subcategory-Aware Convolutional Networks for Object Detection.IEEE Trans Pattern Anal Mach Intell. 2018 Oct;40(10):2522-2528. doi: 10.1109/TPAMI.2017.2756936. Epub 2017 Sep 26. IEEE Trans Pattern Anal Mach Intell. 2018. PMID: 28961103
-
Face Detection With Different Scales Based on Faster R-CNN.IEEE Trans Cybern. 2019 Nov;49(11):4017-4028. doi: 10.1109/TCYB.2018.2859482. Epub 2018 Aug 14. IEEE Trans Cybern. 2019. PMID: 30113907
Cited by
-
Feature diffusion reconstruction mechanism network for crop spike head detection.Front Plant Sci. 2024 Oct 1;15:1459515. doi: 10.3389/fpls.2024.1459515. eCollection 2024. Front Plant Sci. 2024. PMID: 39439510 Free PMC article.
-
DCS-YOLO: Defect detection model for new energy vehicle battery current collector.PLoS One. 2024 Oct 29;19(10):e0311269. doi: 10.1371/journal.pone.0311269. eCollection 2024. PLoS One. 2024. PMID: 39471148 Free PMC article.
-
WCAY object detection of fractures for X-ray images of multiple sites.Sci Rep. 2024 Nov 4;14(1):26702. doi: 10.1038/s41598-024-77878-6. Sci Rep. 2024. PMID: 39496710 Free PMC article.
-
Federated deep learning for detecting COVID-19 lung abnormalities in CT: a privacy-preserving multinational validation study.NPJ Digit Med. 2021 Mar 29;4(1):60. doi: 10.1038/s41746-021-00431-6. NPJ Digit Med. 2021. PMID: 33782526 Free PMC article.
-
Morphologic identification of clinically encountered moulds using a residual neural network.Front Microbiol. 2022 Oct 14;13:1021236. doi: 10.3389/fmicb.2022.1021236. eCollection 2022. Front Microbiol. 2022. PMID: 36312928 Free PMC article.
LinkOut - more resources
Full Text Sources
Other Literature Sources
Miscellaneous