Abstract
Virtual reality (VR) is a scientific method and technology created during the exploration of the nature by human beings to understand, simulate, and better adapt and use the nature. Based on the analysis on the whole process of VR, this paper presents different categories of VR problems and a type of theoretical expression, and abstracts three kinds of scientific and technical problems in VR field. On the basis of foresaid content, this paper also studies current major research objectives, research results and development trend of VR in the aspects of VR modeling method, VR representation technology, human-machine interaction and devices, VR development suites and supporting infrastructure, as well as VR applications. Finally, several theoretical and technical problems that need to be further studied and solved are addressed.
Similar content being viewed by others
References
Heilig M L. Sensorama simulator. US Patent 3 050 870, 1962-08-28
Sutherland I E. The ultimate display. In: Proceedings of the International Federation of Information Processing (IFIP) Congress, 1965. 506–508
Fisher S S, Humphries J, McGreevy M, et al. The virtual environment display system. In: ACM Workshop on Interactive 3D Graphics. New York: ACM Press, 1986. 77–87
Foley J D. Interfaces for advanced computing (cover story). Sci Am Mag, October 1987
Michael H. Metaphysics of Virtual Reality. Oxford: Oxford University Press, 1993
Grigore B, Phillippe C. Virtual Reality Technology. New York: John Wiley and Sons, 1994
Wang C W, Gao W, Wang X R. Theory, Realization and Application of Virtual Reality (VR) Technology (in Chinese). Beijing: Tsinghua University Press, 1996
Zhao Q P. DVENET Distributed Virtual Environment (in Chinese). Beijing: Science Press, 2002
Huang K D, Liu B H, Huang J, et al. Overview of battle simulation technology (in Chinese). J Syst Simul, 2004, 16(9): 1887–1895
Dong S H. Man-machine Interaction (in Chinese). Beijing: Beijing University Press, 2004
Pan Y H, Fan J S. Reality and Virtuality of Tunhuang (in Chinese). Hangzhou: Zhejiang Univeristy Press, 2003
Li B H, Chai X D. Preliminary research and development of complex product virtual sample machine supporting platform (in Chinese). Comput Simul, 2003, 20(1): 4–8
Li D R. Function of digital province and city in state land planning and town construction (in Chinese). J Survey Mapp, 2002, 31(Supplement): 16–21
Sun J G. Computer Graphics (in Chinese). Beijing: Tsinghua University Press, 2002
Dai G Z. Wearable interaction computation (in Chinese). High-tech Commun, 2001, 7: 51–55
Peng Q S. Arithmetic Basis of Computer Photo-realism Graphic (in Chinese). Beijing: Science Press, 1999
Chen C S, Hung Y P, Chung J B. A fast automatic method for registration of partially-overlapping range images. In: Proceedings of IEEE ICCV1998, 1998. 242–248
Huang Q X, Simon F, Gelfaln N, et al. Reassembling fractured objects by geometric matching. ACM Trans Graph, 2006, 25: 569–578
Huber D. Automatic three-dimensional modeling from reality. PhD thesis. Pittsburgh: Carnegie Mellon University, 2002
Amenta N, Bern M, Kamvysselis M. A new voronoi-based surface reconstruction algorithm. In: Cohen M, ed. Proceedings of SIGGRAPH’98. New York: ACM Press, 1998. 415–421
Liepa P. Filling holes in meshes. In: Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing. P. O. Box 16 Aire-la-Ville Switzerland: Eurographics Association, 2003. 200–205
Davis J, Marschner S R, Garr M, et al. Filling holes in complex surfaces using volumetric diffusion. In: First International Symposium on 3D Data Processing, Visualization, and Transmission. 2002. 19–21
Ju T. Robust repair of polygonal models. ACM Trans Graph, 2004, 23(3): 888–895
Pauly M, Mitra N J, Giesen J, et al. Example-based 3D scan completion. In: Symposium on Geometry Processing. 2005. 23–32
Sharf A, Alexa M. Context-based surface completion. ACM Trans Graph, 2004, 23(3): 878–887
Mueller P, Zeng G, Wonka P, et al. Image-based procedural modeling of facades. ACM Trans Graph, 2007, 26(3): 85
Hartley R I, Zisserman A. Multiple View Geometry. Cambridge, UK: Cambridge University Press, 2004
Scharstein D, Szeliski R. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int J Comput Vision, 2002, 47(1): 7–42
Wei Y, Ofek E, Quan L, et al. Modeling hair from multiple views. In: Proceedings of ACM SIGGRAPH, 2005. 816–820
Tan P, Zeng G, Wang J D, et al. Image-based tree modeling. Proc ACM SIGGRAPH, 2007, 26(87): 1–7
Matusik W, Pfister H, Ngan A, et al. Image-based 3D photography using opacity hulls. In: Proceedings of ACM SIGGRAPH, San Antonio, Texas, 2002. 427–437
Nicodemus F E, Richmond J C, Hsia J J, et al. Geometrical Considerations and Nomenclature for Reflectance. Washington: National Bureau of Standards, 1997. 1–67
Ngan A, Durand F, Amatusik W. Experimental analysis of BRDF models. In: Eurographics Symposium on Rendering, 2005. 117–226
Jason L, Aner B -A, Christopher D, et al. Inverse shade trees for non-parametric material representation and editing. ACM Trans Graph, 2006, 25: 735–745
Dana K J, Ginneken B V, Nayar S K, et al. Reflectance and texture of real-world surfaces. ACM Trans Graph, 1999, 18: 1–34
Gu J W, Chien I T, Ravi R, et al. Time-varying surface appearance: acquisition, modeling and rendering. ACM Trans Graph, 2006, 25: 762–771
Kalyan S, Ravi R, Peter N B, et al. Time-varying BRDFs. IEEE Trans Visual Comput Graph, 2007, 13: 595–609
Jaffery S M, Dutta K. Digital reconstruction methods for 3D image visulization. In: SPIE Processings and Display of Three-Dimensional Data II, 1984. 155–159
Helgeland A, Andreassen O. Visualization of vector fields using seed LIC and volume rendering. IEEE Trans Visual Comput Graph, 2004, 10(6): 673–682
Taponecco F, Alexa M. Vector field visualization using markov random field texture synthesis. In: Proceedings of the Symposium on Data Visualisation. Switzerland: Eurographics Association, 2003. 195–202
Kaufman D M, Edmunds T, Pai D K. Fast frictional dynamics for rigid bodies. ACM Trans Graph, 2005, 24(3): 946–956
Wong W S -K, Baciu G. A randomized marking scheme for continuous collision detection in simulation of deformable surfaces. In: Proceedings of the 2006 ACM International Conference on Virtual Reality Continuum and Its Applications. New York: ACM Press, 2006. 181–188
Govindaraju N K, Kabul I, Lin M C, et al. Fast continuous collision detection among deformable models using graphics processors. Comput Graph, 2007, 31(1): 5–14
Sorkine O. Laplacian mesh processing. State of the Art Reports. 2005
Botsch M, Sumner R, Pauly M, et al. Deformation transfer for detail-preserving surface editing. In: Proceedings of Vision, Modeling, and Visualization (VMV’ 06). Ios Pr Inc, 2006. 357–364
Thomaszewski B, Wacker M, Straßer W. A consistent bending model for cloth simulation with corotational subdivision finite elements. In: Proceedings of the 2006 ACM SIGGRAPH/ Eurographics Symposium on Computer Animation. Switzerland: Eurographics Association, 2006. 107–116
Müller M, Heidelberger B, Hennix M, et al. Position based dynamics. J Visual Commun Image Represent, 2007, 18(2): 109–118
Shi L, Yu Y, Bell N, et al. A fast multigrid algorithm for mesh deformation. ACM Trans Graph, 2006, 25(3): 1108–1117
Huang J, Shi X, Liu X, et al. Subspace gradient domain mesh deformation. ACM Trans Graph, 2006, 25(3): 1126–1134
Botsch M, Sorkine O. On linear variational surface deformation methods. IEEE Trans Visual Comput Graph, 2008, 14(1): 213–230
Eitz M, Gu L X. Hierarchical spatial hashing for real-time collision detection. In: IEEE International Conference on Shape Modeling and Applications (SMI’07). Los Alamitos: IEEE Computer Society Press, 2007. 61–70
Witkin A, Zoran P. Motion wraping. In: ACM SIGGRAPH. Addison Wesley, 1995. 105–108
Park S I, Shin H J, Shin S Y. On-line locomotion generation based on motion blending. In: Proceedings of ACM SIGGRAPH Symposium on Computer Animation. New York: ACM, 2002. 105–111
Girard M. Constrained Optimization of Articulated Animal Movement in Computer Animation. Making Them Move: Mechanics, Control, and Animation of Articulated Figures. Badler B, Zelter, eds. San Francisco: Morgan Kaufmann Publishers, 1990. 209–232
Pew R W, Mavor A S. Modeling Human and Organizational Behavior: Application to Military Simulations. Washington, DC: National Academy Press, 1998
Karr C R, Holbrook R. Modeling Command and Control in WARSIM 2000. In: Proceedings of the 8th Conference on Computer Generated Forces and Behavioral Representation, 1999
Commercial Platform Training Aids. Los Angeles: Institute for Creative Technologies, University of Southern California. http://www.ict.usc.edu/content/view/49/103
Hoff B R. USMC individual combatants. In: Proceedings of the Defense Modeling and Simulation Office Individual Combatant Workshop, VA: Defense Modeling and Simulation Office, Alexandria, July 1–2, 1996
Cora B E -T, Nicholas R J. Using reinforcement learning to coordinate better. Comput Intell, 2005, 21(3): 217–245
Kazakov D, Bartlett M. Cooperation navigation and the faculty of language. Appl Art Intell, 2004, 18(9–10): 885–901
Soar/IFOR: intelligent agents for air simulation and control. In: Nielsen P E, ed. Simulation Conference Proceedings, 3–6 Dec. 1995. 620–625
Regenbrecht H, Wagner M. Interaction in a collaborative augmented reality environment. In: CHI’ 02 Extended Abstracts on Human Factors in Computing Systems. New York: ACM, 2002. 504–505
Allard J, Ménier C, Raffin B, et al. Grimage: markerless 3D interactions. In: ACM SIGGRAPH 2007 Emerging Technologies. New York: ACM, 2007
Ercan A O, Yang D B, Gamal A E, et al. Optimal placement and selection of camera network nodes for target localization. In: Proceedings of Second IEEE International Conference on Distributed Computing in Sensor Systems (DCOSS). Berlin: Springer, 2006. 389–404
Fusiello A, Murino V. Augmented scene modeling and visualization by optical and acoustic sensor integration. IEEE Trans Visual Comput Graph, 2004, 10(6): 625–636
Billinghurst M, Kato H, Poupyrev I. MagicBook: transitioning between reality and virtuality. In: CHI’ 01 Extended Abstracts on Human Factors in Computing Systems. New York: ACM, 2001. 25–26
Didier J Y, Roussel D, Mallem M, et al. A texture based time delay compensation method for augmented reality. In: 3rd IEEE and ACM International Symposium on Mixed and Augmented. 2004. 262–263
Chen X W, Milgram P. Integration of pointed-based interposition with binocular disparity alignment in stereoscopic augmented reality environments. In: The Conference on IRIS, 2002
Huang Y, Essa I. Tracking multiple objects through occlusions. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, DC: IEEE Computer Society, 2005. 1051–1058
Schmidt J, Niemann H, Vogt S. Dense disparity maps in realtime with an application to augmented reality. In: Sixth IEEE Workshop on Applications of Computer Vision. Washington, DC: IEEE Computer Society, 2002. 225–230
Pilet J, Geiger A, Pascal L, et al. An all-in-one solution to geometric and photometric calibration. In: IEEE/ACM International Symposium on Mixed and Augmented Reality. Washington, DC: IEEE Computer Society, 2006. 69–78
Jacobs K, Nahmias J D, Angus C, et al. Automatic generation of consistent shadows for augmented reality. In: Proceedings of Graphics Interface 2005. Ontario, Canada: Human-Computer Communications Society, 2005. 113–120
Kanbara M, Yokoya N. Real-time estimation of light source environment for photorealistic augmented reality. In: Proceedings of the 17th International Conference on Pattern Recognition. Washington, DC: IEEE Computer Society, 2004. 911–914
Hoffman N, Mitchell K. Real-time photorealistic terrain lighting. Game Develop, 2001, 8(7): 32–41
Sloan P -P, Kautz J, Snyder J. Pre-computed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. In: SIGGRAPH’ 02: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques. New York: ACM Press, 2002. 527–536
Ng R, Ramamoorthi R, Hanrahan P. All-frequency shadows using non-linear wavelet lighting approximation. ACM Trans Graph, 2003, 22(3): 376–381
Zhou K, Hu Y, Lin S, et al. Pre-computed shadow fields for dynamic scenes. ACM Trans Graph, 2005, 24(3): 1196–1201
Sloan P -P, Luna B, Snyder J. Local, deformable pre-computed radiance transfer. ACM Trans Graph, 2005, 24(3): 1216–1224
Ren Z, Wang R, Snyder J, et al. Real-time soft shadows in dynamic scenes using spherical harmonic exponentiation. ACM Trans Graph, 2006, 25(3): 977–986
Blinn J F. Simulation of wrinkled surfaces. In: Proceedings SIGGRAPH’ 78, 1978. 286–292
Cook R L. Shade trees. In: Proceedings of SIGGRAPH’ 84, Computer Graphics. 1984, 18: 223–231
Kaneko T, Takahei T, Inami M, et al. Detailed shape representation with parallax mapping. In: Proceedings of the ICAT 2001, 2001. 205–208
Oliveira M M, Bishop G, McAllister D. Relief texture mapping. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, 2000. 359–368
Reeves W T, Blau R. Approximate and probabilistic algorithms for shadingand rending structured particle system. In: Proceedings of SIGGRAPH85, Computer Graphics. 1985, 19(3): 313–322
Yuksel C, House D H, Keyser J. Water particles. In: Proceedings SIGGRAPH. New York: ACM Press, 2007. 99–106
Adams B, Pauly M, Keiser R, et al. Adaptively sampled particle fluids. In: ACM SIGGRAPH, 2007
Moon J T, Marschner S R. Simulating multiple scattering in hair using a photon mapping approach. In: International Conference on Computer Graphics and Interactive Techniques, ACM SIGGRAPH’06, 2006. 1067–1074
Quan L, Tan P, Zeng G, et al. Image-based plant modeling. ACM Trans Graph (TOG) and Proc. of SIGGRAPH 2006, 2006, 25(3): 599–604
Lindstrom P, Silva C. A memory insensitive technique for large model simplification. In: IEEE Visualization’ 01, 2001
Hoppe H. View-dependent refinement of progressive meshes. In: Proc. SIGGRAPH’97, Los Angeles, CA, 1997. 189–198
Hoppe H. Progressive meshes. In: Proceedings of the SIGGRAPH’96. 1996, 99–108
Molnar S, Cox M, Ellsworth D, et al. A sorting classification of parallel rendering. IEEE Comp Graph Appl, 1994, 23–31
Adelson E H, Bergen J R. The plenoptic function and the elements of early vision. Computational Models of Visual Processing. Canbridge: The MIT Press, 1991
Shum H -Y, He L -W. Rendering with concentric mosaics. In: SIGGRAPH’99 Computer Graphics, 1999. 299–306
Hayashi K, Kato H, Nishida S. Occlusion detection of real objects using contour based stereo matching. In: Proceedings of the 2005 International Conference on Augmented Teleexistence, 2005. 180–186
Pilet J, Lepetit V, Fua P. Retexturing in the presence of complex illumination and occlusions. In: International Symposium on Mixed and Augmented Reality, Nara, Japan, November 2007
Bradley D, Roth G, Bose P. Augmented reality on cloth with realistic illumination. Mach Vision Appl J, 2007
Jung Y, Franke T, Dähne P, et al. Enhancing X3D for advanced MR appliances. In: ACM Special Interest Group on Computer Graphics and Interactive Techniques, Perugia, Italy, 2007. 27–36
Xie B S, Zhong X L, Rao D, et al. Head-related transfer function database and its analyses. Sci China Ser G-Phys Mech Astron, 2007, 50(3): 267–280
Zotkin D N, Duraiswami R, Davis L S. Victual audio system customization using visual matching of ear parameters. In: Proceedings of IEEE 16th International Conference on Pattern Recognition, 2002
Ionue N. HRTF modeling using physical features. In: Proceedings of Forum Acusticum. Budapest, 2005
Brown C P, Duda R O. A structural model for binaural sound synthesis. IEEE Trans Speech Audio Process, 1998, 6(5): 476–488
Middlebrooks J C. Individual difference in external ear transfer functions reduced by scaling in frequenty. J Acoust Soc Am, 1999, 106(3): 1480–1492
Basdogan C, Srinivasan M A. Haptic rendering in virtual environments. In: Stanney K, ed. Virtual Environments Hand Book. NJ: Lawrence Erlbaum Inc, 2001
Otaduy M A, Lin Ming C. Introduction to haptic rendering. In: International Conference on Computer Graphics and Interactive Techniques, ACM SIGGRAPH 2005, 2005. A3–A33
Wang Y T. Strengthen realistic research progress. In: The 5th China Computer Graphics Conference, 2005
Kruger W, Bohn C A, Frohlich B, et al. The responsive workbench: a virtual work environment. Computer, 1995, 28(7): 42–48
Neira C C, Danie J S, Thomas A D, et al. The CAVE: audio visual experience automatic virtual environment. Commun ACM, 1992, 35(6): 64–72
Rohs M. Marker-based embodied interaction for handheld augmented reality games. J Virtual Reality Broadcast, 2007, 4(5): 793–805
Jones A, Ian M, Yamada H, et al. Rendering for an interactive 360 deg; light field display. In: ACM SIGGRAPH 2007 papers. New York: ACM, 2007
Chen X W, Milgram P. Integration of pointed-based interposition with binocular disparity alignment in stereoscopic augmented reality environments. In: The Conference on IRIS, 2002
Templeman J N, Denbrook P S, Sibert L E. Virtual locomotion: walking in place through virtual environments. Presence: Teleoperat Virtual Environ, 1999, 8(6): 598–617
ISO/IEC 14772-1:1997 and ISO/IEC 14772-2:2004 Virtual Reality Modeling Language (VRML)
X3D architecture and Base Components Edition 2, ISO/IEC FDIS 19775-1.2:2008, Final Draft International Standard, Dec 2007
Universal 3D Specification, http://www.3dif.org. 3D Industry Forum (3DIF)
Zhao Q P, Hao A M, Wang L L, et al. Real-time 3D graphic platform BH_Graph, Comput Research Develop, 2006, 43(9): 1491–1497
IEEE Std 1278–1993: IEEE Standard for Information Technology-Protocols for Distributed Interactive Simulation Applications, Entity Information and Interaction, 1993
Simulation Interoperability Standards Committee (SISC) of the IEEE Computer Society. IEEE Standard for Modeling and Simulation (M&S) High Level Architecture (HLA) IEEE std 1516–2000, 1516.1–2000, 1516.2–2000. New York: The Institute of Electrical and Electronics Engineers Inc., 2000
Zhou Z, Zhao Q P. Reducing time cost of distributed run-time infrastructure. In: Proceedings of the 16th Internal Conference on Artificial Reality and Telexistence, Hangzhou, Nov 29–Dec 02, 2006, Springer LNCS, 2006, 4282: 969–979
Arthur R P, Rechard L S. The SIMNET Network and Protocols. BBN Systems and Technologies Corporation, Report No. 7627, 1991
Preim B, Bartz D. Visualization in Medicine: Theory, Algorithms and Applications. San Francisco: Morgan Kaufmann Publishers Inc., 2007
Seymour N E, Gallagher A G, Roman S A, et al. Virtual reality surgical laparoscopic simulators: how to choose. Surgic Endosc, 2003, 17: 1943–1950
Andujar C, Fairen M, Brunet P. Affordable projection system for 3D interaction. In: 1st Ibero-American Symposium in Computer Graphics. University of Minho, Portugal, July 2002
Glor P J, Boyle E S. Design evaluation for personnel, training and human factors (DEPTH). In: Reliability and Maintainability Symposium, Proceedings Annual, 1993. 18–25
Zhao Q P, Shen X K, Qi Y. Some key technology research on digital museum. J Syst Simulat, 2007, 19(Supp. 2): 1–6
Author information
Authors and Affiliations
Corresponding author
Additional information
Supported by the National Basic Research Program of China (Grant No. 2009CB320805), the National Natural Science Foundation of China (Grant Nos. 60533070, 60503066), and the National High-Tech Research & Development Program of China (Grant Nos. 2006AA01Z333, 2006AA01Z311)
Rights and permissions
About this article
Cite this article
Zhao, Q. A survey on virtual reality. Sci. China Ser. F-Inf. Sci. 52, 348–400 (2009). https://doi.org/10.1007/s11432-009-0066-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11432-009-0066-0