{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,24]],"date-time":"2025-03-24T07:27:01Z","timestamp":1742801221333},"reference-count":36,"publisher":"ASME International","issue":"4","content-domain":{"domain":["asmedigitalcollection.asme.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2013,12,1]]},"abstract":"Recent development of per-frame motion extraction method can generate the skeleton of human motion in real-time with the help of RGB-D cameras such as Kinect. This leads to an economic device to provide human motion as input for real-time applications. As generated by a single-view image plus depth information, the extracted skeleton usually has problems of unwanted vibration, bone-length variation, self-occlusion, etc. This paper presents an approach to overcome these problems by synthesizing the skeletons generated by duplex Kinects, which capture the human motion in different views. The major technical difficulty of this synthesis comes from the inconsistency of two skeletons. Our algorithm is formulated under the constrained optimization framework by using the bone-lengths as hard constraints and the tradeoff between inconsistent joint positions as soft constraints. Schemes are developed to detect and re-position the problematic joints generated by per-frame method from duplex Kinects. As a result, we develop an easy, cheap and fast approach that can improve the skeleton of human motion at an average speed of 5\u2009ms per frame.<\/jats:p>","DOI":"10.1115\/1.4025404","type":"journal-article","created":{"date-parts":[[2013,9,12]],"date-time":"2013-09-12T10:33:42Z","timestamp":1378982022000},"update-policy":"http:\/\/dx.doi.org\/10.1115\/crossmarkpolicy-asme","source":"Crossref","is-referenced-by-count":55,"title":["Improved Skeleton Tracking by Duplex Kinects: A Practical Approach for Real-Time Applications"],"prefix":"10.1115","volume":"13","author":[{"given":"Kwok-Yun","family":"Yeung","sequence":"first","affiliation":[]},{"given":"Tsz-Ho","family":"Kwok","sequence":"additional","affiliation":[]},{"given":"Charlie C. L.","family":"Wang","sequence":"additional","affiliation":[{"name":"Associate Professor Fellow ASME e-mail:\u2002 Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Hong Kong 1, China"}]}],"member":"33","published-online":{"date-parts":[[2013,10,16]]},"reference":[{"issue":"5","key":"2019100316501543900_B1","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1109\/38.708558","article-title":"Motion Control of Virtual Humans","volume":"18","year":"1998","journal-title":"IEEE Comput. Graph. Appl."},{"key":"2019100316501543900_B2","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1016\/S0097-8493(02)00280-7","article-title":"Easybowling: A Small Bowling Machine Based on Virtual Simulation","volume":"27","year":"2003","journal-title":"Comput. Graph."},{"issue":"2","key":"2019100316501543900_B3","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1109\/TLT.2010.27","article-title":"A Virtual Reality Dance Training System Using Motion Capture Technology","volume":"4","year":"2011","journal-title":"IEEE Trans. Learn. Technol."},{"issue":"3","key":"2019100316501543900_B4","first-page":"132","article-title":"New Possibilities for Human Motion Studies by Real-Time Light Spot Position Measurement","volume":"1","year":"1974","journal-title":"Biotelemetry"},{"key":"2019100316501543900_B5","article-title":"Vicon Motion Capture System","author":"Vicon"},{"key":"2019100316501543900_B6","article-title":"Xsens MVN","author":"Xsens"},{"issue":"4","key":"2019100316501543900_B7","doi-asserted-by":"crossref","first-page":"949","DOI":"10.1109\/JOE.2006.880386","article-title":"Robust Rangeonly Beacon Localization","volume":"31","year":"2006","journal-title":"J. Ocean. Eng."},{"key":"2019100316501543900_B8","doi-asserted-by":"crossref","unstructured":"Hazas, M., and Ward, A., 2002, \u201cA Novel Broadband Ultrasonic Location System,\u201d Proceedings of the 4th International Conference on Ubiquitous Computing, pp. 264\u2013280.","DOI":"10.1007\/3-540-45809-3_21"},{"key":"2019100316501543900_B9"},{"key":"2019100316501543900_B10","author":"Measurand"},{"key":"2019100316501543900_B11","unstructured":"Foxlin, E., and Harrington, M., 2000, \u201cWeartrack: A self-Referenced Head and Hand Tracker for Wearable Computers and Portable VR,\u201d Proceedings of the 4th IEEE International Symposium on Wearable Computers, pp. 155\u2013162."},{"key":"2019100316501543900_B12","doi-asserted-by":"crossref","unstructured":"Bachmann, E. R., McGhee, R. B., Yun, X., and Zyda, M. J., 2001, \u201cInertial and Magnetic Posture Tracking for Inserting Humans into Networked Virtual Environments,\u201d Proceedings of the ACM Symposium on Virtual Reality Software and Technology, pp. 9\u201316.","DOI":"10.1145\/505009.505011"},{"issue":"3","key":"2019100316501543900_B13","first-page":"35:1","article-title":"Practical Motion Capture in Everyday Surroundings","volume":"26","year":"2007","journal-title":"ACM Trans. Graph."},{"key":"2019100316501543900_B14","article-title":"Microsoft Kinect for Windows SDK","author":"Microsoft"},{"key":"2019100316501543900_B15","doi-asserted-by":"crossref","unstructured":"Hauswiesner, S., Straka, M., and Reitmayr, G., 2011, \u201cFree Viewpoint Virtual Try-On With Commodity Depth Cameras,\u201d Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, pp. 23\u201330.","DOI":"10.1145\/2087756.2087759"},{"key":"2019100316501543900_B16","doi-asserted-by":"crossref","unstructured":"Wilson, A. D., and Benko, H., 2010, \u201cCombining Multiple Depth Cameras and Projectors for Interactions on, Above and Between Surfaces,\u201d Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology, pp. 273\u2013282.","DOI":"10.1145\/1866029.1866073"},{"key":"2019100316501543900_B17","doi-asserted-by":"crossref","unstructured":"Newcombe, R. A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A. J., Kohli, P., Shotton, J., Hodges, S., and Fitzgibbon, A., 2011, \u201cKinectfusion: Real-Time Dense Surface Mapping and Tracking,\u201d Proceedings of the 2011 10th IEEE International Symposium on Mixed and Augmented Reality, pp. 127\u2013136.","DOI":"10.1109\/ISMAR.2011.6092378"},{"key":"2019100316501543900_B18","doi-asserted-by":"crossref","unstructured":"Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., and Fitzgibbon, A., 2011, \u201cKinectfusion: Real-Time 3d Reconstruction and Interaction Using a Moving Depth Camera,\u201d Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, pp. 559\u2013568.","DOI":"10.1145\/2047196.2047270"},{"key":"2019100316501543900_B19","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1109\/TVCG.2012.56","article-title":"Scanning 3D Full Human Bodies Using Kinects","volume":"18","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"2019100316501543900_B20","doi-asserted-by":"crossref","unstructured":"Weiss, A., Hirshberg, D., and Black, M., 2011, \u201cHome 3D Body Scans From Noisy Image and Range Data,\u201d 2011 IEEE International Conference on Computer Vision (ICCV), pp. 1951\u20131958.","DOI":"10.1109\/ICCV.2011.6126465"},{"key":"2019100316501543900_B21","doi-asserted-by":"crossref","unstructured":"Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., and Blake, A., 2011, \u201cReal-Time Human Pose Recognition in Parts From Single Depth Images,\u201d Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, CVPR\u201911, IEEE Computer Society, pp. 1297\u20131304.","DOI":"10.1109\/CVPR.2011.5995316"},{"key":"2019100316501543900_B22","article-title":"Activate3D's Intelligent Character Motion (ICM)","author":"Activate3D"},{"issue":"2","key":"2019100316501543900_B23","first-page":"90","article-title":"A Survey of Advances in Vision-Based Human Motion Capture and Analysis","volume":"104","year":"2006","journal-title":"Comput. Vis. Image Underst."},{"issue":"1\u20132","key":"2019100316501543900_B24","first-page":"4","article-title":"Vision-Based Human Motion Analysis: An Overview","volume":"108","year":"2007","journal-title":"Comput. Vis. Image Underst."},{"key":"2019100316501543900_B25","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/38.708559","article-title":"Verbs and Adverbs: Multidimensional Motion Interpolation Using Radial Basis Functions","volume":"18","year":"1998","journal-title":"IEEE Comput. Graph. Appl."},{"key":"2019100316501543900_B26","doi-asserted-by":"crossref","unstructured":"Piazza, T., Lundstr\u00f6m, J., Hugestrand, A., Kunz, A., and Fjeld, M., 2009, \u201cTowards Solving the Missing Marker Problem in Realtime Motion Capture,\u201d Proceedings of ASME 2009 IDETC\/CIE Conference, pp. 1521\u20131526.","DOI":"10.1115\/DETC2009-86517"},{"key":"2019100316501543900_B27","unstructured":"Li, L., McCann, J., Pollard, N., and Faloutsos, C., 2010, \u201cBoLeRO: A Principled Technique for Including Bone Length Constraints in Motion Capture Occlusion Filling,\u201d Proceedings of the 2010 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation, pp. 179\u2013188."},{"issue":"4","key":"2019100316501543900_B28","first-page":"33:1","article-title":"Spatial Relationship Preserving Character Motion Adaptation","volume":"29","year":"2010","journal-title":"ACM Trans. Graph."},{"key":"2019100316501543900_B29","unstructured":"Caon, M., Yue, Y., Tscherrig, J., Mugellini, E., and Khaled, O. A., 2011, \u201cContext-Aware 3D Gesture Interaction Based on Multiple Kinects,\u201d Proceedings of The First International Conference on Ambient Computing, Applications, Services and Technologies, AMBIENT 2011."},{"issue":"5","key":"2019100316501543900_B30","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1109\/JSTSP.2012.2196975","article-title":"Human Pose Estimation and Activity Recognition from Multi-View Videos: Comparative Explorations of Recent Developments","volume":"6","year":"2012","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"2019100316501543900_B31","article-title":"3D Scan Matching and Registration. ICCV 2005 Short Course"},{"key":"2019100316501543900_B32","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1145\/325165.325242","article-title":"Animating Rotation With Quaternion Curves","volume":"19","year":"1985","journal-title":"SIGGRAPH Comput. Graph."},{"key":"2019100316501543900_B33","doi-asserted-by":"crossref","unstructured":"Maimone, A., and Fuchs, H., 2012, \u201cReducing Interference Between Multiple Structured Light Depth Sensors Using Motion,\u201d 2012 IEEE Virtual Reality Conference, pp. 51\u201354.","DOI":"10.1109\/VR.2012.6180879"},{"key":"2019100316501543900_B34","doi-asserted-by":"crossref","unstructured":"Plagemann, C., Ganapathi, V., Koller, D., and Thrun, S., 2010, \u201cReal-Time Identification and Localization of Body Parts From Depth Images,\u201d 2010 IEEE International Conference on Robotics and Automation, pp. 3108\u20133113.","DOI":"10.1109\/ROBOT.2010.5509559"},{"issue":"4","key":"2019100316501543900_B35","first-page":"102:1","article-title":"Learning 3D Mesh Segmentation and Labeling","volume":"29","year":"2010","journal-title":"ACM Trans. Graph."},{"key":"2019100316501543900_B36","doi-asserted-by":"crossref","unstructured":"Baak, A., M\u00fcller, M., Bharaj, G., Seidel, H.-P., and Theobalt, C., 2011, \u201cA Data-Driven Approach for Real-Time Full Body Pose Reconstruction From a Depth Camera,\u201d IEEE 13th International Conference on Computer Vision (ICCV), pp. 1092\u20131099.","DOI":"10.1109\/ICCV.2011.6126356"}],"container-title":["Journal of Computing and Information Science in Engineering"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/doi\/10.1115\/1.4025404\/6099553\/jcise_013_04_041007.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/doi\/10.1115\/1.4025404\/6099553\/jcise_013_04_041007.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,10,3]],"date-time":"2019-10-03T20:50:45Z","timestamp":1570135845000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article\/doi\/10.1115\/1.4025404\/370848\/Improved-Skeleton-Tracking-by-Duplex-Kinects-A"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,10,16]]},"references-count":36,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2013,12,1]]}},"URL":"https:\/\/doi.org\/10.1115\/1.4025404","relation":{},"ISSN":["1530-9827","1944-7078"],"issn-type":[{"value":"1530-9827","type":"print"},{"value":"1944-7078","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,10,16]]}}}