{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,27]],"date-time":"2024-08-27T17:10:28Z","timestamp":1724778628319},"reference-count":35,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2019,8,8]],"date-time":"2019-08-08T00:00:00Z","timestamp":1565222400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Using consumer depth cameras at close range yields a higher surface resolution of the object, but this makes more serious noises. This form of noise tends to be located at or on the edge of the realistic surface over a large area, which is an obstacle for real-time applications that do not rely on point cloud post-processing. In order to fill this gap, by analyzing the noise region based on position and shape, we proposed a composite filtering system for using consumer depth cameras at close range. The system consists of three main modules that are used to eliminate different types of noise areas. Taking the human hand depth image as an example, the proposed filtering system can eliminate most of the noise areas. All algorithms in the system are not based on window smoothing and are accelerated by the GPU. By using Kinect v2 and SR300, a large number of contrast experiments show that the system can get good results and has extremely high real-time performance, which can be used as a pre-step for real-time human-computer interaction, real-time 3D reconstruction, and further filtering.<\/jats:p>","DOI":"10.3390\/s19163460","type":"journal-article","created":{"date-parts":[[2019,8,8]],"date-time":"2019-08-08T15:05:32Z","timestamp":1565276732000},"page":"3460","source":"Crossref","is-referenced-by-count":4,"title":["A New Filtering System for Using a Consumer Depth Camera at Close Range"],"prefix":"10.3390","volume":"19","author":[{"given":"Yuanxing","family":"Dai","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering and Automation, Northeastern University, Shenyang 110004, China"}]},{"given":"Yanming","family":"Fu","sequence":"additional","affiliation":[{"name":"Laboratory Management Center, Shenyang Sport University, Shenyang 110102, China"}]},{"given":"Baichun","family":"Li","sequence":"additional","affiliation":[{"name":"College of Aeronautical Engineering, Civil Aviation University of China, Tianjin 300000, China"}]},{"given":"Xuewei","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering and Automation, Northeastern University, Shenyang 110004, China"}]},{"given":"Tianbiao","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering and Automation, Northeastern University, Shenyang 110004, China"}]},{"given":"Wanshan","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering and Automation, Northeastern University, Shenyang 110004, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.cviu.2014.01.007","article-title":"Automatic detection of calibration grids in time-of-flight images","volume":"121","author":"Hansard","year":"2014","journal-title":"Comput. Vision Image Understanding"},{"key":"ref_2","first-page":"354","article-title":"Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications","volume":"8200","author":"Grzegorzek","year":"2013","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Draelos, M., Deshpande, N., and Grant, E. (2012, January 13\u201315). The Kinect up close: Adaptations for short-range imaging. Proceedings of the Multisensor Fusion & Integration for Intelligent Systems, Hamburg, Germany.","DOI":"10.1109\/MFI.2012.6343067"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"17397","DOI":"10.1007\/s11042-017-5310-9","article-title":"Guided 3D point cloud filtering","volume":"77","author":"Han","year":"2018","journal-title":"Multimedia Tools Appl."},{"key":"ref_5","unstructured":"Buttazzo, G., Lipari, G., Abeni, L., and Caccamo, M. (2005). Soft Real-Time Systems: Predictability vs. Efficiency (Series in Computer Science), Plenum Publishing Co."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/j.future.2011.05.017","article-title":"Workflow management for soft real-time interactive applications in virtualized environments","volume":"28","author":"Gogouvitis","year":"2012","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1133","DOI":"10.1007\/s00371-013-0894-1","article-title":"Real-time and robust hand tracking with a single depth camera","volume":"30","author":"Ma","year":"2014","journal-title":"Vis. Comput."},{"key":"ref_8","first-page":"1168","article-title":"Advanced Methods of Three Dimensional Data Obtaining for Virtual and Augmented Reality","volume":"1025","author":"Torok","year":"2014","journal-title":"Adv. Mater. Res."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1109\/THMS.2015.2453203","article-title":"Robust Biometric Recognition From Palm Depth Images for Gloved Hands","volume":"45","author":"Nguyen","year":"2015","journal-title":"IEEE Trans. Hum. -Mach. Syst."},{"key":"ref_10","unstructured":"Deng, X., Yang, S., Zhang, Y., Tan, P., Chang, L., and Wang, H. (2017). Hand3D: Hand Pose Estimation using 3D Neural Network. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Sun, X., Wei, Y., Liang, S., Tang, X., and Sun, J. (2015, January 7\u201312). Cascaded hand pose regression. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298683"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Qian, C., Sun, X., Wei, Y., Tang, X., and Sun, J. (2014, January 24\u201327). Realtime and Robust Hand Tracking from Depth. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.145"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Gaglio, S., and Lo Re, G. (2014). 3D Scene Reconstruction Using Kinect. Advances onto the Internet of Things: How Ontologies Make the Internet of Things Meaningful, Springer International Publishing.","DOI":"10.1007\/978-3-319-03992-3"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1016\/j.cag.2012.04.011","article-title":"Enhanced personal autostereoscopic telepresence system using commodity depth cameras","volume":"36","author":"Maimone","year":"2012","journal-title":"Comput. Graph."},{"key":"ref_15","unstructured":"Buades, A., Coll, B., and Morel, J. (2005, January 20\u201325). A non-local algorithm for image denoising. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"664","DOI":"10.1109\/TIP.2008.919949","article-title":"Adaptive Bilateral Filter for Sharpness Enhancement and Noise Removal","volume":"17","author":"Zhang","year":"2008","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"664","DOI":"10.1145\/1015706.1015777","article-title":"Digital photography with flash and no-flash image pairs","volume":"23","author":"Petschnigg","year":"2004","journal-title":"ACM Trans. Graph."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"7331","DOI":"10.1007\/s11042-014-1982-6","article-title":"Comparative evaluation of methods for filtering Kinect depth data","volume":"74","author":"Essmaeel","year":"2015","journal-title":"Multimed. Tools Appl."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1109\/TCYB.2016.2637661","article-title":"Edge-Preserving Depth Map Upsampling by Joint Trilateral Filter","volume":"48","author":"Lo","year":"2018","journal-title":"IEEE Trans. Cybern."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1276377.1276379","article-title":"Image deblurring with blurred\/noisy image pairs","volume":"26","author":"Yuan","year":"2007","journal-title":"ACM Trans. Graph."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"11362","DOI":"10.3390\/s140711362","article-title":"Directional Joint Bilateral Filter for Depth Images","volume":"14","author":"Le","year":"2014","journal-title":"Sensors"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"063021","DOI":"10.1117\/1.JEI.23.6.063021","article-title":"Hole filling using joint bilateral filtering for moving object segmentation","volume":"23","author":"Ran","year":"2014","journal-title":"J. Electron. Imaging"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"4313","DOI":"10.1007\/s11042-016-3374-6","article-title":"RGB-D datasets using microsoft kinect or similar sensors: A survey","volume":"76","author":"Cai","year":"2017","journal-title":"Multimedia Tools Appl."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1560","DOI":"10.1109\/TCYB.2013.2271112","article-title":"Depth-Color Fusion Strategy for 3-D Scene Modeling With Kinect","volume":"43","author":"Camplani","year":"2013","journal-title":"IEEE Trans. Cybern."},{"key":"ref_25","unstructured":"Reshetyuk, Y. (2009). Terrestrial Laser Scanning: Error Sources, Self-Calibration and Direct Georeferencing, VDM Verlag."},{"key":"ref_26","unstructured":"International Organization for Standardization (2019, August 07). ISO\/IEC\/IEEE 60559:2011, Information Technology\u2014Microprocessor Systems\u2014Floating-Point Arithmetic. Available online: https:\/\/www.iso.org\/standard\/57469.html."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1400","DOI":"10.1002\/mp.12801","article-title":"Technical Note: Kinect V2 surface filtering during gantry motion for radiotherapy applications","volume":"45","author":"Nazir","year":"2018","journal-title":"Med. Phys."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Yu, Y., Song, Y., Zhang, Y., and Wen, S. (2012, January 5\u20139). A Shadow Repair Approach for Kinect Depth Maps. Proceedings of Computer Vision\u2013ACCV 2012, Proceedings of the 11th Asian Conference on Computer Vision, Daejeon, Korea.","DOI":"10.1007\/978-3-642-37447-0_47"},{"key":"ref_29","unstructured":"(2019, May 31). Accuracy (Trueness and Precision) of Measurement Methods and Results\u2014Part 1: General Principles and Definitions. Available online: https:\/\/www.iso.org\/standard\/11833.html."},{"key":"ref_30","unstructured":"(2019, May 20). Filtering a PointCloud Using a PassThrough Filter. Available online: http:\/\/pointclouds.org\/documentation\/tutorials\/passthrough.php."},{"key":"ref_31","first-page":"5","article-title":"One-sided and Two-sided Critical Values for Dixon\u2019s Outlier Test for Sample Sizes up to n = 30","volume":"23","year":"2008","journal-title":"Econ. Qual. Control"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/0734-189X(88)90121-1","article-title":"A new chain-coding algorithm for binary images using run-length codes","volume":"41","author":"Kim","year":"1988","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_33","unstructured":"(2019, May 20). Structural Analysis and Shape Descriptors. Available online: https:\/\/docs.opencv.org\/2.4\/modules\/imgproc\/doc\/structural_analysis_and_shape_descriptors.html?highlight=findcon#cv2.findContours."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.patrec.2011.09.032","article-title":"Color based skin classification","volume":"33","author":"Khan","year":"2012","journal-title":"Pattern Recognit. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Kang, S.I., Roh, A., and Hong, H. (2011, January 9\u201312). Using depth and skin color for hand gesture classification. Proceedings of the IEEE International Conference on Consumer Electronics, Las Vegas, NV, USA.","DOI":"10.1109\/ICCE.2011.5722513"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/16\/3460\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,19]],"date-time":"2024-06-19T17:37:18Z","timestamp":1718818638000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/16\/3460"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,8]]},"references-count":35,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["s19163460"],"URL":"https:\/\/doi.org\/10.3390\/s19163460","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,8,8]]}}}