{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,7,28]],"date-time":"2024-07-28T09:11:16Z","timestamp":1722157876849},"reference-count":37,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T00:00:00Z","timestamp":1606435200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the National Natural Science Foundation of China (NSFC) General Program","award":["61673353"]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"Detecting moving objects in a video sequence is an important problem in many vision-based applications. In particular, detecting moving objects when the camera is moving is a difficult problem. In this study, we propose a symmetric method for detecting moving objects in the presence of a dynamic background. First, a background compensation method is used to detect the proposed region of motion. Next, in order to accurately locate the moving objects, we propose a convolutional neural network-based method called YOLOv3-SOD for detecting all objects in the image, which is lightweight and specifically designed for small objects. Finally, the moving objects are determined by fusing the results obtained by motion detection and object detection. Missed detections are recalled according to the temporal and spatial information in adjacent frames. A dataset is not currently available specifically for moving object detection and recognition, and thus, we have released the MDR105 dataset comprising three classes with 105 videos. Our experiments demonstrated that the proposed algorithm can accurately detect moving objects in various scenarios with good overall performance.<\/jats:p>","DOI":"10.3390\/sym12121965","type":"journal-article","created":{"date-parts":[[2020,11,28]],"date-time":"2020-11-28T08:51:16Z","timestamp":1606553476000},"page":"1965","source":"Crossref","is-referenced-by-count":19,"title":["Moving Object Detection Based on Background Compensation and Deep Learning"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"http:\/\/orcid.org\/0000-0001-9222-712X","authenticated-orcid":false,"given":"Juncai","family":"Zhu","sequence":"first","affiliation":[{"name":"School of Electrical Engineering, Zhengzhou University, Zhengzhou 450000, China"}]},{"given":"Zhizhong","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering, Zhengzhou University, Zhengzhou 450000, China"}]},{"given":"Songwei","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering, Zhengzhou University, Zhengzhou 450000, China"}]},{"given":"Shuli","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering, Zhengzhou University, Zhengzhou 450000, China"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lee, S.H., Kwon, S.C., Shim, J.W., Lim, J.E., and Yoo, J. (2019). WisenetMD: Motion Detection Using Dynamic Background Region Analysis. Symmetry, 11.","DOI":"10.3390\/sym11050621"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1421","DOI":"10.1007\/s13369-019-03969-6","article-title":"Efficient and Fast Objects Detection Technique for Intelligent Video Surveillance Using Transfer Learning and Fine-Tuning","volume":"45","author":"Ahmadi","year":"2020","journal-title":"Arab. J. Sci. Eng."},{"key":"ref_3","first-page":"97","article-title":"A vision-based approach for intelligent robot navigation","volume":"9","author":"Genci","year":"2010","journal-title":"Int. J. Intell. Syst. Technol. Appl."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1108\/IR-09-2012-402","article-title":"A template reconstruction scheme for moving object detection from a mobile robot","volume":"40","author":"Tsai","year":"2013","journal-title":"Ind. Robot"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yin, G., Li, Y., and Zhang, J. (2008, January 28\u201329). The Research of Video Tracking System Based on Virtual Reality. Proceedings of the 2008 International Conference on Internet Computing in Science and Engineering, Harbin, China.","DOI":"10.1109\/ICICSE.2008.44"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.ijmedinf.2017.10.010","article-title":"Imperceptible watermarking for security of fundus images in tele-ophthalmology applications and computer-aided diagnosis of retina diseases","volume":"108","author":"Singh","year":"2017","journal-title":"Int. J. Med. Inform."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"491","DOI":"10.5573\/JSTS.2018.18.4.491","article-title":"Design of Moving Object Detector Based on Modified GMM Algorithm for UAV Collision Avoidance","volume":"18","author":"Cho","year":"2018","journal-title":"J. Semicond. Technol. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1404","DOI":"10.1109\/TITS.2019.2909915","article-title":"Moving Object Detection Through Image Bit-Planes Representation Without Thresholding","volume":"21","author":"Lin","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1016\/j.rti.2005.03.006","article-title":"Optical flow-based real-time object tracking using non-prior training active feature model","volume":"11","author":"Shin","year":"2005","journal-title":"Real-Time Imaging"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Fan, X., Cheng, Y., and Qiang, F. (2015, January 24\u201326). Moving Target Detection Algorithm Based on Susan Edge Detection and Frame Difference. Proceedings of the International Conference on Information Science and Control Engineering, Shanghai, China.","DOI":"10.1109\/ICISCE.2015.78"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Jarraya, S.K., Hammami, M., and Han\u00eane, B.-A. (2010, January 1\u20133). Accurate Background Modeling for Moving Object Detection in a Dynamic Scene. Proceedings of the International Conference on Digital Image Computing: Techniques and Applications, Sydney, Australia.","DOI":"10.1109\/DICTA.2010.18"},{"key":"ref_12","first-page":"6","article-title":"Object Detection Based on Motion Vector Compensation in Dynamic Background","volume":"38","author":"Wang","year":"2019","journal-title":"Ordnance Ind. Autom."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Rodriguez, P., and Wohlberg, B. (2015, January 27\u201330). Translational and rotational jitter invariant incremental principal component pursuit for video background modeling. Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QC, Canada.","DOI":"10.1109\/ICIP.2015.7350856"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1109\/TCSVT.2010.2087811","article-title":"Background Compensation for Pan-Tilt-Zoom Cameras Using 1-D Feature Matching and Outlier Rejection","volume":"21","author":"Suhr","year":"2011","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2015). You Only Look Once: Unified, Real-Time Object Detection. arXiv.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_16","unstructured":"Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","first-page":"4092","article-title":"Background Subtraction for Moving Cameras based on trajectory-controlled segmentation and Label Inference","volume":"9","author":"Yin","year":"2015","journal-title":"KSII Trans. Internet Inf. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Brox, T., and Malik, J. (2010, January 5\u201311). Object Segmentation by Long Term Analysis of Point Trajectories. Proceedings of the 11th European Conference on Computer Vision, Heraklion, Greece.","DOI":"10.1007\/978-3-642-15555-0_21"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.patcog.2016.07.031","article-title":"Trajectory Aligned Features For First Person Action Recognition","volume":"62","author":"Singh","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1109\/TPAMI.2003.1195991","article-title":"Kernel-based object tracking","volume":"25","author":"Comaniciu","year":"2003","journal-title":"Pattern Anal. Mach. Intell."},{"key":"ref_22","unstructured":"Hyeonseob, N., and Bohyung, H. (2016, January 27\u201330). Learning Multi-Domain Convolutional Neural Networks for Visual Tracking. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA."},{"key":"ref_23","unstructured":"Martin, D., Goutam, B., Fahad, S.K., and Michael, F. (2017, January 21\u201326). ECO: Efficient Convolution Operators for Tracking. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA."},{"key":"ref_24","unstructured":"Raychaudhuri, A., Maity, S., Chakrabarti, A., and Bhattacharjee, D. (2017, January 24). Detection of Moving Objects in Video Using Block-Based Approach. Proceedings of the International Conference on Computational Intelligence, Communications, and Business Analytics, Kolkata, India."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Nozari, A., and Hoseini, S.M. (2015, January 25\u201331). Recognition of Moving Objects in Videos of Moving Camera with Harris Attributes. Proceedings of the 2015 Fourteenth Mexican International Conference on Artificial Intelligence (MICAI), Cuernavaca, Mexico.","DOI":"10.1109\/MICAI.2015.13"},{"key":"ref_26","first-page":"2824","article-title":"Moving object detection based on SIFT features matching and K-means clustering","volume":"32","author":"Guang","year":"2012","journal-title":"J. Comput. Appl."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1638","DOI":"10.4028\/www.scientific.net\/AMM.602-605.1638","article-title":"A Moving Object Detection Algorithm Based on ORB under Dynamic Scene","volume":"602\u2013605","author":"Luo","year":"2014","journal-title":"Appl. Mech. Mater."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Hafiane, A., Palaniappan, K., and Seetharaman, G. (2008, January 7\u201311). UAV-Video Registration Using Block-Based Features. Proceedings of the 2008 IEEE International Geoscience and Remote Sensing Symposium, Boston, MA, USA.","DOI":"10.1109\/IGARSS.2008.4779192"},{"key":"ref_29","unstructured":"Setyawan, F.A., Tan, J.K., Kim, H., and Ishikawa, S. (2014, January 9\u201312). Detection of Moving Objects in a Video Captured by a Moving Camera Using Error Reduction. Proceedings of the SICE Annual Conference, Hokaido University, Sapporo, Japan."},{"key":"ref_30","unstructured":"Nicolai, W., Alex, B., and Dietrich, P. (2017, January 17\u201320). Simple Online and Realtime Tracking with a Deep Association Metric. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., and Berg, A.C. (2016, January 8\u201316). SSD: Single Shot MultiBox Detector. Proceedings of the 2016 European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Dollar, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017). Feature Pyramid Networks for Object Detection. arXiv.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Rosten, E., and Drummond, T. (2006, January 7\u201313). Machine learning for high-speed corner detection. Proceedings of the 9th European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_34"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Gool, L.V. (2006, January 7\u201313). SURF: Speeded up robust features. Proceedings of the 9th European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_37","unstructured":"Fu, C., Liu, W., Ranga, A., Tyagi, A., and Berg, A.C. (2017). DSSD: Deconvolutional Single Shot Detector. arXiv."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/12\/1965\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,6]],"date-time":"2024-07-06T00:06:39Z","timestamp":1720224399000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/12\/1965"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,27]]},"references-count":37,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["sym12121965"],"URL":"https:\/\/doi.org\/10.3390\/sym12121965","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,27]]}}}