Abstract
Virtual reality (VR) is being used for training and research in various industries due to its greater immersion relative to flat screen simulation technology. However, the effect of immersive VR displays and background storylines (i.e., narrative) on metacognitive skills, such as sensemaking, remains unexplored. The current study employed a 2 × 2 between-subjects experimental design to investigate the influence of display type and narrative medium on sensemaking for an observation-based driving task. Sixty-eight adults were semi-randomly assigned to one of four conditions. Participants received a pre-mission narrative briefing (text or multimedia) and undertook two simulated driving missions (flat screen or VR display). A structured debriefing followed each mission to assess sensemaking in terms of frequency and type of explanation for mission events. The results indicate that both display type and narrative medium influence sensemaking in virtual environments. For explanations relating to previously encountered mission events, sensemaking frequency was higher in the VR conditions than the flat screen conditions (F(1) = 9.11, p = .004, partial η2 = .15). For explanations relating to the briefing materials, sensemaking frequency was higher in the multimedia narrative conditions than the text-based narrative conditions (F(1) = 8.38, p = .005, partial η2 = .14). Although the findings suggest that VR displays have cognitive benefits over traditional flat screen displays, the likelihood of VR-induced adverse effects (i.e., cybersickness) should be managed (e.g., limiting exposure). These results indicate that narrative medium and display type should be carefully considered by industries using virtual environments for training and research.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ancona, D.: Sensemaking, framing and acting in the unknown. In: Snook, S., Norhia, N., Khurana, R. (eds.) The Handbook for Teaching Leadership: Knowing, Doing and Being, pp. 1–19. Sage Publications, Los Angeles, CA (2012)
Bambrick, S., Whitbred, R., Skalski, P., Bracken, C.: Is text always superior to video? Investigating the impact of moving images, standard video, and text on presence. In: Proceedings of the Presence Live! Conference. International Society for Presence Research, Philadelphia, USA (2012)
Belanich, J., Mullin, L.N., Dressel, J.D.: Symposium on PC-based simulations and gaming for military training (ARI Research Product 200–01). U.S. Army Research Institute for the Behavioral and Social Sciences, Arlington, V.A. (2004)
Bohemia Interactive Simulations. https://bisimulations.com/. Accessed 15 August 2015
Bruck, S., Watters, P.A.: Estimating cybersickness of simulated motion using the simulator sickness questionnaire (SSQ): a controlled study. In: Proceedings of the 2009 Sixth International Conference on Computer Graphics, Imaging and Visualization, pp. 486–488. IEEE Computer Society, Los Alamitos, California (2009)
Brunner, C., Fidock, J.J.T., Temby, P., Whitney, S.J.: Examining the effect of simulator fidelity on task performance and training transfer with an ICT device. In: SimTecT 2015 Conference Proceedings, pp. 183–191. Simulation Australasia, Adelaide, SA (2015)
Chapman, P., Selvarajah, S., Webster, J.: Engagement in multimedia training systems. In: Proceedings of the 32nd Hawaii International Conference on System Sciences, pp. 1–9. IEEE Press, Washington, DC (1999)
Choi, S.S., Jung, K., Noh, S.D.: Virtual reality applications in manufacturing industries: past research, present findings, and future directions. Concur. Eng. Res. Appl. 23(1), 40–63 (2015)
Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychol. Measur. 20, 37–46 (1960)
Diemer, J., Alpers, G.W., Peperkorn, H.M., Shiban, Y., Műhlberger, A.: The impact of perception and presence on emotional reactions: a review of research in virtual reality. Front. in Psychol. 6(26), 1–9 (2015)
Dunston, P.S., Proctor, R.W., Wang, X.: Challenges in evaluating skill transfer from construction equipment simulators. Theor. Issues Ergon. Sci. 15(4), 354–375 (2014)
Endsley, M.R.: Toward a theory of situation awareness in dynamic systems. Hum. Factors 37(1), 32–64 (1995)
Endsley, M.R.: Situation awareness misconceptions and misunderstandings. J. Cogn. Eng. Decis. Making 9(1), 4–32 (2015)
Endsley, M.R., Jones, D.G.: Designing for Situation Awareness: An Approach to Human-Centered Design, 2nd edn. Taylor and Francis, London (2012)
Fiore, S.M., Johnston, J., McDaniel, R.: Applying the narrative form and XML metadata to debriefing simulation-based exercises. In: Proceedings of the 49th Annual Meeting of the Human Factors and Ergonomics Society, pp. 2135–2139. Human Factors and Ergonomics Society, Santa Monica, CA (2005)
Gibson, R.: Narrative sense-making in complex scenarios seminar. In: Simulation Australasia, Canberra, ACT (2015)
Golding, J.F.: Predicting individual differences in motion sickness susceptibility by questionnaire. Pers. Individ. Differ. 41(2), 237–248 (2006)
Grabowski, A., Jankowski, J.: Virtual reality-based pilot training for underground coal miners. Saf. Sci. 72, 310–314 (2015)
Kennedy, R., Lane, N., Berbaum, K., Lilienthal, M.: Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. Int. J. Aviat. Psychol. 3(3), 203–220 (1993)
Knerr, B.W.: Immersive simulation training for the dismounted soldier. U.S. Army Research Institute for the Behavioral and Social Sciences, Orlando, FL (2007)
Lee, E.A.-L., Wong, K.W.: Learning with desktop virtual reality: low spatial ability learners are more positively correlated. Comput. Educ. 79, 49–58 (2014)
Maitlis, S., Christianson, M.: Sensemaking in organizations: taking stock and moving forward. Acad. Manag. Ann. 8(1), 57–125 (2014)
Marion, N., Septseault, C., Boudinot, A., Querrec, R.: GASPAR: aviation management on aircraft carrier using virtual reality. In: 2007 International Conference on Cyberworlds, pp. 15–22. IEEE Computer Society, Hanover, Germany (2007)
Morris, C.S., Hancock, P.A., Shirkey, E.C.: Motivational effects of adding context relevant stress in PC-based game training. Mil. Psychol. 16(2), 135–147 (2004)
Patrey, J., Breaux, R., Andrew, M., Sheldon, E.: What is essential for virtual reality to meet military performance goals? Performance measurement in VR. In: Research and Technology Organization Human Factors and Medicine Panel Workshop Meeting Proceedings. North Atlantic Treaty Organization, The Hague, The Netherlands (2001)
Riener, R., Harders, M.: Virtual reality in Medicine. Springer, London (2012). https://doi.org/10.1007/978-1-4471-4011-5
Seitz, C.A., Poyrazli, S., Harrison, M.A., Flickinger, T., Turkson, M.: Virtual reality exposure therapy for military veterans with posttraumatic stress disorder: a systematic review. New Sch. Psychol. Bull. 11(1), 14–29 (2014)
Slater, M., Wilbur, S.: A framework for immersive virtual environments (FIVE): speculations on the role of presence in virtual environments. Presence: Teleoperators Virtual Environ. 6(6), 603–616 (1997)
Stevens, J.A., Kincaid, J.P.: The relationship between presence and performance in virtual simulation training. Open J. Model. Simul. 3, 41–48 (2015)
Stokes, M., Johnson, K., Fidock, J., Delfabbro, P.: The effect of accumulated sleep loss on usability of digital command and control technology. J. Battlefield Technol. 18(1), 31–38 (2015)
Stone, R.J.: Whatever happened to virtual reality? Inf. Prof. 1(4), 12–15 (2004)
Taylor, G.S., Barnett, J.S.: Evaluation of wearable simulation interface for military training. Hum. Factors 55(3), 672–690 (2013)
The OBS Project. https://obsproject.com/. Accessed 31 August 2015
Weick, K.E.: The Social Psychology of Organizing, 2nd edn. McGraw-Hill, New York (1979)
Weick, K.E.: The collapse of sensemaking in organizations: the Mann Gulch disaster. Adm. Sci. Q. 38(4), 628–652 (1993)
Weick, K.E.: Sensemaking in Organizations. Sage Publications, Thousand Oaks (1995)
Whitney, S.J., Fidock, J.J.T., Ferguson, N.: Assessing the effectiveness of simulation-based counter-IED training. J. Battlefield Technol. 15(1), 57–64 (2012)
Wiederhold, M.D.: Physiological monitoring during simulation training and testing. U.S. Army Research Office, Durham, NC (2005)
Youngblut, C., Huie, O.: The relationship between presence and performance in virtual environments: results of a VERTS study. In: Proceedings of IEEE Virtual Reality Conference 2003, pp. 277–278. IEEE Computer Society Press, Los Angeles, CA (2003)
Acknowledgements
This research was funded by the Australian Army’s Land 400 Project. The research project was conducted by the first author at the Defence Science and Technology Group in partial fulfilment of the degree of Master of Psychology (Organisational and Human Factors) at the University of Adelaide. At the time of publication, the first author is now solely employed by Consilium Technology Pty Ltd. The authors would also like to acknowledge the study participants for their time and valuable contributions.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Hibbard, S.J., Whitney, S.J., Carter, L., Fidock, J.J.T., Temby, P., Thiele, L. (2018). Making Virtual Sense: Display Type and Narrative Medium Influence Sensemaking in Virtual Environments. In: Naweed, A., Wardaszko, M., Leigh, E., Meijer, S. (eds) Intersections in Simulation and Gaming. ISAGA SimTecT 2016 2016. Lecture Notes in Computer Science(), vol 10711. Springer, Cham. https://doi.org/10.1007/978-3-319-78795-4_16
Download citation
DOI: https://doi.org/10.1007/978-3-319-78795-4_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-78794-7
Online ISBN: 978-3-319-78795-4
eBook Packages: Computer ScienceComputer Science (R0)