Scanning 3D full human bodies using Kinects
- PMID: 22402692
- DOI: 10.1109/TVCG.2012.56
Scanning 3D full human bodies using Kinects
Abstract
Depth camera such as Microsoft Kinect, is much cheaper than conventional 3D scanning devices, and thus it can be acquired for everyday users easily. However, the depth data captured by Kinect over a certain distance is of extreme low quality. In this paper, we present a novel scanning system for capturing 3D full human body models by using multiple Kinects. To avoid the interference phenomena, we use two Kinects to capture the upper part and lower part of a human body respectively without overlapping region. A third Kinect is used to capture the middle part of the human body from the opposite direction. We propose a practical approach for registering the various body parts of different views under non-rigid deformation. First, a rough mesh template is constructed and used to deform successive frames pairwisely. Second, global alignment is performed to distribute errors in the deformation space, which can solve the loop closure problem efficiently. Misalignment caused by complex occlusion can also be handled reasonably by our global alignment algorithm. The experimental results have shown the efficiency and applicability of our system. Our system obtains impressive results in a few minutes with low price devices, thus is practically useful for generating personalized avatars for everyday users. Our system has been used for 3D human animation and virtual try on, and can further facilitate a range of home–oriented virtual reality (VR) applications.
Similar articles
-
Real-time 3D human capture system for mixed-reality art and entertainment.IEEE Trans Vis Comput Graph. 2005 Nov-Dec;11(6):706-21. doi: 10.1109/TVCG.2005.105. IEEE Trans Vis Comput Graph. 2005. PMID: 16270863
-
Virtual surgery simulation for medical training using multi-resolution organ models.Int J Med Robot. 2007 Jun;3(2):149-58. doi: 10.1002/rcs.140. Int J Med Robot. 2007. PMID: 17619246
-
Depth-color fusion strategy for 3-D scene modeling with Kinect.IEEE Trans Cybern. 2013 Dec;43(6):1560-71. doi: 10.1109/TCYB.2013.2271112. IEEE Trans Cybern. 2013. PMID: 24273141
-
[Virtual reality in medicine].Radiologe. 1995 Sep;35(9):563-8. Radiologe. 1995. PMID: 8588036 Review. German.
-
Capturing behaviour for the use of avatars in virtual environments.Cyberpsychol Behav. 2003 Oct;6(5):537-44. doi: 10.1089/109493103769710569. Cyberpsychol Behav. 2003. PMID: 14583129 Review.
Cited by
-
Calibration of the Relative Orientation between Multiple Depth Cameras Based on a Three-Dimensional Target.Sensors (Basel). 2019 Jul 8;19(13):3008. doi: 10.3390/s19133008. Sensors (Basel). 2019. PMID: 31288439 Free PMC article.
-
Easy and Fast Reconstruction of a 3D Avatar with an RGB-D Sensor.Sensors (Basel). 2017 May 12;17(5):1113. doi: 10.3390/s17051113. Sensors (Basel). 2017. PMID: 28498339 Free PMC article.
-
Sensor Architectures and Technologies for Upper Limb 3D Surface Reconstruction: A Review.Sensors (Basel). 2020 Nov 18;20(22):6584. doi: 10.3390/s20226584. Sensors (Basel). 2020. PMID: 33217994 Free PMC article. Review.
-
Accurate body composition measures from whole-body silhouettes.Med Phys. 2015 Aug;42(8):4668-77. doi: 10.1118/1.4926557. Med Phys. 2015. PMID: 26233194 Free PMC article.
-
An Overview on Image-Based and Scanner-Based 3D Modeling Technologies.Sensors (Basel). 2023 Jan 4;23(2):596. doi: 10.3390/s23020596. Sensors (Basel). 2023. PMID: 36679393 Free PMC article. Review.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources