{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T16:14:44Z","timestamp":1740154484081,"version":"3.37.3"},"reference-count":58,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2019,3,27]],"date-time":"2019-03-27T00:00:00Z","timestamp":1553644800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"Object detection in optical remote sensing images is still a challenging task because of the complexity of the images. The diversity and complexity of geospatial object appearance and the insufficient understanding of geospatial object spatial structure information are still the existing problems. In this paper, we propose a novel multi-model decision fusion framework which takes contextual information and multi-region features into account for addressing those problems. First, a contextual information fusion sub-network is designed to fuse both local contextual features and object-object relationship contextual features so as to deal with the problem of the diversity and complexity of geospatial object appearance. Second, a part-based multi-region fusion sub-network is constructed to merge multiple parts of an object for obtaining more spatial structure information about the object, which helps to handle the problem of the insufficient understanding of geospatial object spatial structure information. Finally, a decision fusion is made on all sub-networks to improve the stability and robustness of the model and achieve better detection performance. The experimental results on a publicly available ten class data set show that the proposed method is effective for geospatial object detection.<\/jats:p>","DOI":"10.3390\/rs11070737","type":"journal-article","created":{"date-parts":[[2019,3,29]],"date-time":"2019-03-29T07:38:52Z","timestamp":1553845132000},"page":"737","source":"Crossref","is-referenced-by-count":35,"title":["A Novel Multi-Model Decision Fusion Network for Object Detection in Remote Sensing Images"],"prefix":"10.3390","volume":"11","author":[{"given":"Wenping","family":"Ma","sequence":"first","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}]},{"given":"Qiongqiong","family":"Guo","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3459-5079","authenticated-orcid":false,"given":"Yue","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Xidian University, Xi\u2019an 710071, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3575-473X","authenticated-orcid":false,"given":"Wei","family":"Zhao","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0379-2042","authenticated-orcid":false,"given":"Xiangrong","family":"Zhang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}]},{"given":"Licheng","family":"Jiao","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,3,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2837","DOI":"10.1007\/s11042-018-5982-9","article-title":"Social media and satellites","volume":"78","author":"Ahmad","year":"2019","journal-title":"Multimed. Tools Appl."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ahmad, K., Pogorelov, K., Riegler, M., Ostroukhova, O., Halvorsen, P., Conci, N., and Dahyot, R. (arXiv, 2019). Automatic detection of passable roads after floods in remote sensed and social media data, arXiv.","DOI":"10.1016\/j.image.2019.02.002"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1156","DOI":"10.1109\/TGRS.2008.2008440","article-title":"Urban-Area and Building Detection Using SIFT Keypoints and Graph Theory","volume":"47","author":"Sirmacek","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Tang, T., Zhou, S., Deng, Z., Zou, H., and Lei, L. (2017). Vehicle Detection in Aerial Images Based on Region Convolutional Neural Networks and Hard Negative Example Mining. Sensors, 17.","DOI":"10.3390\/s17020336"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2327","DOI":"10.1109\/JSTARS.2013.2242846","article-title":"Airborne Vehicle Detection in Dense Urban Areas Using HoG Features and Disparity Maps","volume":"6","author":"Tuermer","year":"2013","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4511","DOI":"10.1109\/TGRS.2013.2282355","article-title":"Ship Detection in High-Resolution Optical Imagery Based on Anomaly Detector and Local Shape Feature","volume":"52","author":"Shi","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.isprsjprs.2016.03.014","article-title":"A Survey on Object Detection in Optical Remote Sensing Images","volume":"117","author":"Cheng","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 11\u201318). Fast R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_11","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (July, January 26). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 8\u201316). SSD: Single Shot MultiBox Detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Gidaris, S., and Komodakis, N. (2015, January 11\u201318). Object Detection via a Multi-region and Semantic Segmentation-Aware CNN Model. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.135"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yang, X., Sun, H., Fu, K., Yang, J., Sun, X., Yan, M., and Guo, Z. (2018). Automatic Ship Detection in Remote Sensing Images from Google Earth of Complex Scenes Based on Multiscale Rotation Dense Feature Pyramid Networks. Remote Sens., 10.","DOI":"10.3390\/rs10010132"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2486","DOI":"10.1109\/TGRS.2016.2645610","article-title":"Accurate Object Localization in Remote Sensing Images Based on Convolutional Neural Networks","volume":"55","author":"Long","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"7405","DOI":"10.1109\/TGRS.2016.2601622","article-title":"Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images","volume":"54","author":"Cheng","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1469","DOI":"10.1109\/LGRS.2017.2712638","article-title":"Airport Detection Based on a Multiscale Fusion Feature for Optical Remote Sensing Images","volume":"14","author":"Xiao","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ren, Y., Zhu, C., and Xiao, S. (2018). Deformable Faster R-CNN with Aggregating Multi-Layer Features for Partially Occluded Object Detection in Optical Remote Sensing Images. Remote Sens., 10.","DOI":"10.3390\/rs10091470"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2337","DOI":"10.1109\/TGRS.2017.2778300","article-title":"Rotation-Insensitive and Context-Augmented Object Detection in Remote Sensing Images","volume":"56","author":"Li","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1293","DOI":"10.1109\/LGRS.2017.2708722","article-title":"M-FCN: Effective Fully Convolutional Network-Based Airplane Detection Framework","volume":"14","author":"Yang","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Xu, Y., Zhu, M., Li, S., Feng, H., Ma, S., and Che, J. (2018). End-to-End Airport Detection in Remote Sensing Images Combining Cascade Region Proposal Networks and Multi-Threshold Detection Networks. Remote Sens., 10.","DOI":"10.3390\/rs10101516"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Guo, W., Yang, W., Zhang, H., and Hua, G. (2018). Geospatial Object Detection in High Resolution Satellite Images Based on Multi-Scale Convolutional Neural Network. Remote Sens., 10.","DOI":"10.3390\/rs10010131"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Chen, S., Zhan, R., and Zhang, J. (2018). Geospatial Object Detection in Remote Sensing Imagery Based on Multiscale Single-Shot Detector with Activated Semantics. Remote Sens., 10.","DOI":"10.3390\/rs10060820"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3688","DOI":"10.1109\/JSTARS.2018.2866284","article-title":"Multilevel Building Detection Framework in Remote Sensing Images Based on Convolutional Neural Networks","volume":"11","author":"Liu","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1109\/LGRS.2017.2683495","article-title":"Feature Extraction by Rotation-Invariant Matrix Representation for Object Detection in Aerial Image","volume":"14","author":"Wang","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"4895","DOI":"10.1109\/JSTARS.2015.2467377","article-title":"A Hierarchical Oil Tank Detector With Deep Surrounding Features for High-Resolution Optical Satellite Imagery","volume":"8","author":"Zhang","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.isprsjprs.2014.10.007","article-title":"A generic discriminative part-based model for geospatial object detection in optical remote sensing images","volume":"99","author":"Zhang","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/LGRS.2013.2246538","article-title":"Object Detection in High-Resolution Remote Sensing Images Using Rotation Invariant Parts Based Model","volume":"11","author":"Zhang","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.isprsjprs.2013.08.001","article-title":"Object detection in remote sensing imagery using a discriminatively trained mixture model","volume":"85","author":"Cheng","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.isprsjprs.2014.10.002","article-title":"Multi-class geospatial object detection and geographic image classification based on collection of part detectors","volume":"98","author":"Cheng","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_32","unstructured":"Cheng, G., Han, J., Zhou, P., and Guo, L. (2014, January 13\u201318). Scalable multi-class geospatial object detection in high-spatial-resolution remote sensing images. Proceedings of the IEEE Geoscience and Remote Sensing Symposium, Quebec City, QC, Canada."},{"key":"ref_33","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201326). Histograms of oriented gradients for human detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3325","DOI":"10.1109\/TGRS.2014.2374218","article-title":"Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning","volume":"53","author":"Han","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"911","DOI":"10.1109\/TGRS.2018.2862899","article-title":"Locality and Structure Regularized Low Rank Representation for Hyperspectral Image Classification","volume":"57","author":"Wang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_37","unstructured":"Fei-Fei, L., and Perona, P. (2005, January 20\u201326). A Bayesian hierarchical model for learning natural scene categories. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1109\/LGRS.2014.2358994","article-title":"Weakly Supervised Learning for Target Detection in Remote Sensing Images","volume":"12","author":"Zhang","year":"2014","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1109\/LGRS.2009.2035644","article-title":"Object Classification of Aerial Images with Bag-of-Visual Words","volume":"7","author":"Xu","year":"2010","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.isprsjprs.2013.12.011","article-title":"Efficient, simultaneous detection of multi-class geospatial targets based on visual saliency modeling and discriminative learning of sparse coding","volume":"89","author":"Han","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2017","DOI":"10.1109\/TIP.2010.2099128","article-title":"Saliency and Gist Features for Target Detection in Satellite Images","volume":"20","author":"Li","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Ma, W., Zhang, J., Wu, Y., Jiao, L., Zhu, H., and Zhao, W. (2019). A Novel Two-Step Registration Method for Remote Sensing Images Based on Deep and Local Features. IEEE Trans. Geosci. Remote Sens., 1\u201310.","DOI":"10.1109\/TGRS.2019.2893310"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/TGRS.2018.2849692","article-title":"GETNET: A General End-to-End 2-D CNN Framework for Hyperspectral Image Change Detection","volume":"57","author":"Wang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1155","DOI":"10.1109\/TGRS.2018.2864987","article-title":"Scene Classification With Recurrent Attention of VHR Remote Sensing Images","volume":"57","author":"Wang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1446","DOI":"10.1109\/LGRS.2018.2845549","article-title":"Exploiting ConvNet Diversity for Flooding Identification","volume":"15","author":"Nogueira","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_46","unstructured":"Wiewiora, E., Galleguillos, C., Vedaldi, A., Belongie, S., and Rabinovich, A. (2007, January 14\u201320). Objects in Context. Proceedings of the IEEE International Conference on Computer Vision, Rio de Janeiro, Brazil."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1109\/TPAMI.2014.2343217","article-title":"Contextualizing Object Detection and Classification","volume":"37","author":"Chen","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"944","DOI":"10.1109\/TMM.2016.2642789","article-title":"Attentive Contexts for Object Detection","volume":"19","author":"Li","year":"2017","journal-title":"IEEE Trans. Multimed."},{"key":"ref_49","unstructured":"Bell, S., Zitnick, C.L., Bala, K., and Girshick, R. (July, January 26). Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Chen, X., and Gupta, A. (2017, January 22\u201329). Spatial Memory for Context Reasoning in Object Detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.440"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Liu, Y., Wang, R., Shan, S., and Chen, X. (2018, January 18\u201322). Structure Inference Net: Object Detection Using Scene-Level Context and Instance-Level Relationships. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00730"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Hu, H., Gu, J., Zhang, Z., Dai, J., and Wei, Y. (2018, January 18\u201322). Relation Networks for Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00378"},{"key":"ref_53","unstructured":"Marcu, A., and Leordeanu, M. (arXiv, 2016). Dual Local-Global Contextual Pathways for Recognition in Aerial Imagery, arXiv."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Cho, K., van Merrienboer, B., G\u00fcl\u00e7ehre, \u00c7, Bougares, F., Schwenk, H., and Bengio, Y. (arXiv, 2014). Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation, arXiv.","DOI":"10.3115\/v1\/D14-1179"},{"key":"ref_55","unstructured":"Jaderberg, M., Simonyan, K., Zisserman, A., and Kavukcuoglu, K. (2015, January 7\u201312). Spatial Transformer Networks. Proceedings of the Neural Information Processing Systems 2015, Montreal, QC, Canada."},{"key":"ref_56","unstructured":"Simonyan, K., and Zisserman, A. (arXiv, 2014). Very Deep Convolutional Networks for Large-Scale Image Recognition, arXiv."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L., Li, K., and Fei-Fei, L. (2009, January 20\u201325). ImageNet: A large-scale hierarchical image database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_58","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20138). ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the International Conference on Neural Information Processing Systems, Lake Tahoe, ND, USA."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/7\/737\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,16]],"date-time":"2024-06-16T19:01:38Z","timestamp":1718564498000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/7\/737"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,27]]},"references-count":58,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2019,4]]}},"alternative-id":["rs11070737"],"URL":"https:\/\/doi.org\/10.3390\/rs11070737","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2019,3,27]]}}}