Abstract
Recent advances in low cost RGB-D sensors and progress in reconstruction approaches paves way for creating real-time 3D models of people. It is equally important to enhance the visual appeal of such 3D models with textures. Most of the existing approaches use per-vertex colors, such that the color resolution is limited to mesh resolution. In this paper, we propose a feasible solution for texturing 3D models of people (3D busts) using a low-cost RGB-D sensor setup that automatically constructs the 3D geometry and textures the model in just a few minutes. Experimental evaluations evaluate the performance of the approach on synthetic and real world data against the computational time and visual appeal.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Implementation based on https://github.com/cheind/dest.
- 2.
References
Ichim, A.E., Bouaziz, S., Pauly, M.: Dynamic 3D avatar creation from hand-held video input. ACM Trans. Graph. (TOG) 34, 45 (2015)
Li, H., et al.: 3D self-portraits. ACM Trans. Graph. (TOG) 32, 187 (2013)
Zhou, Q.Y., Koltun, V.: Color map optimization for 3D reconstruction with consumer depth cameras. ACM Trans. Graph. (TOG) 33, 155 (2014)
Baumberg, A.: Blending images for texturing 3D models. In: BMVC, vol. 3, p. 5 (2002)
Waechter, M., Moehrle, N., Goesele, M.: Let there be color! large-scale texturing of 3D reconstructions. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 836–850. Springer, Heidelberg (2014). doi:10.1007/978-3-319-10602-1_54
Maier, R., et al.: Super-resolution keyframe fusion for 3D modeling with high-quality textures. In: 2015 International Conference on 3D Vision (3DV), pp. 536–544. IEEE (2015)
Berjon, D., Moran, F., Garcia, N., et al.: Seamless, static multi-texturing of 3D meshes. Comput. Graph. Forum 34, 228–238 (2015). Wiley Online Library
Newcombe, R.A., et al.: Kinectfusion: real-time dense surface mapping and tracking. In: 2011 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 127–136. IEEE (2011)
Kazhdan, M., et al.: Poisson surface reconstruction. In: Proceedings of the Fourth Eurographics Symposium on Geometry Processing, vol. 7 (2006)
Requicha, A.A., Voelcker, H.B.: Constructive solid geometry (1977)
Rusinkiewicz, S., Levoy, M.: Efficient variants of the icp algorithm. In: Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling, 2001, pp. 145–152. IEEE (2001)
Glassner, A.S.: An Introduction to Ray Tracing. Elsevier, Amsterdam (1989)
Lempitsky, V., et al.: Seamless mosaicing of image-based texture maps. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–6. IEEE (2007)
Allène, C., et al.: Seamless image-based texture atlases using multi-band blending. In: 19th International Conference on Pattern Recognition, pp. 1–4. IEEE (2008)
Gal, R., et al.: Seamless montage for texturing models. Comput. Graph. Forum 29, 479–486 (2010). Wiley Online Library
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, p. I-511. IEEE (2001)
Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1867–1874 (2014)
Szeliski, R., et al.: A comparative study of energy minimization methods for markov random fields with smoothness-based priors. IEEE Trans. Pattern Anal. Mach. Intell. 30, 1068–1080 (2008)
Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient belief propagation for early vision. Int. J. Comput. Vis. 70, 41–54 (2006)
Brown, M., Lowe, D.G.: Automatic panoramic image stitching using invariant features. Int. J. Comput. Vis. 74, 59–73 (2007)
Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. ACM Trans. Graph. (TOG) 22, 313–318 (2003). ACM
Lévy, B., et al.: Least squares conformal maps for automatic texture atlas generation. ACM Trans. Graph. (TOG) 21, 362–371 (2002). ACM
Heckbert, P.S.: Survey of texture mapping. IEEE Comput. Graph. Appl. 6, 56–67 (1986)
Desbrun, M., Meyer, M., Alliez, P.: Intrinsic parameterizations of surface meshes. Comput. Graph. Forum 21, 209–218 (2002). Wiley Online Library
Milenkovic, V.J.: Rotational polygon containment and minimum enclosure using only robust 2D constructions. Comput. Geom. 13, 3–19 (1999)
Murata, H., et al.: Rectangle-packing-based module placement. In: International Conference on Computer-Aided Design, pp. 472–479. IEEE (1995)
Jylänki, J.: A thousand ways to pack the bin-a practical approach to two-dimensional rectangle bin packing (2010). http://clb.demon.fi/files/RectangleBinPack.pdf. Accessed
Borgefors, G.: Distance transformations in digital images. Comput. Vis. Graph. Image Process. 34, 344–371 (1986)
McGuire, M.: Computer graphics archive (2011). http://graphics.cs.williams.edu/data
Li, H., et al.: Global correspondence optimization for non-rigid registration of depth scans. Comput. Graph. Forum 27, 1421–1430 (2008). Wiley Online Library
Acknowledgment
This research is carried out within the “FTI-Projekt ProTechLab” project funded by the State of Upper Austria through the Strategic Economic and Research Program “Innovatives OÖ 2020”.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Heindl, C., Akkaladevi, S.C., Bauer, H. (2016). Capturing Photorealistic and Printable 3D Models Using Low-Cost Hardware. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2016. Lecture Notes in Computer Science(), vol 10072. Springer, Cham. https://doi.org/10.1007/978-3-319-50835-1_46
Download citation
DOI: https://doi.org/10.1007/978-3-319-50835-1_46
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-50834-4
Online ISBN: 978-3-319-50835-1
eBook Packages: Computer ScienceComputer Science (R0)