{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,13]],"date-time":"2024-08-13T10:31:19Z","timestamp":1723545079350},"reference-count":89,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T00:00:00Z","timestamp":1645747200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Virtual Real."],"abstract":"Virtual Reality (VR) systems and VR content are complex, and their creation can mainly be conducted by experts in VR and related areas. That makes the use of VR challenging for experts from other domains, such as educators. In this paper, we build up on existing work and investigate the VR nugget concept\u2014small self-contained VR systems that are built from educational design patterns. Particularly, we extend this concept and introduce structured authoring processes based on VR nuggets that show how standalone, combinable, and reusable VR software can serve as a meta-level guide for various VR applications and involve educators as domain experts. We conduct a user study with VR Forge, a VR-nugget-based authoring software tool, to draw conclusions on how pattern-based VR authoring tools should be designed to support domain experts. We compare our results with those of a related study of the VR nugget tool IN Tiles. Based on the comparative results of usability and hedonic quality measures, both anecdotal evidence and statistically significant results support the concept\u2019s potential for VR authoring conducted by practitioners who are not experts in VR. We derive the recommendation that the design of a VR-nugget-based authoring environment will benefit from using both immersive and desktop user interface (UI) technologies and that the authoring workflow will need authors to frequently alternate between the technologies. We state findings and lessons learned from the development and the studies. We contribute insights in developing reusable and use-case-specific VR content and tools and propose authoring processes that focus on the tasks and goals of domain experts as the primary authoring role within educational VR development. Finally, the relevance of VR-nugget-based authoring is supported by anecdotal evidence gathered from over 3\u00a0years of investigating and applying it within three educational institutions and a company providing education services.<\/jats:p>","DOI":"10.3389\/frvir.2022.840729","type":"journal-article","created":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T07:53:46Z","timestamp":1645775626000},"update-policy":"http:\/\/dx.doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Authoring With Virtual Reality Nuggets\u2014Lessons Learned"],"prefix":"10.3389","volume":"3","author":[{"given":"Robin","family":"Horst","sequence":"first","affiliation":[]},{"given":"Ramtin","family":"Naraghi-Taghi-Off","sequence":"additional","affiliation":[]},{"given":"Linda","family":"Rau","sequence":"additional","affiliation":[]},{"given":"Ralf","family":"Doerner","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2022,2,25]]},"reference":[{"key":"B1","first-page":"444","article-title":"Creating Mixed Reality Content: Problems, Concepts and Solutions","author":"Abawi","year":"2004"},{"key":"B2","doi-asserted-by":"publisher","first-page":"320","DOI":"10.7763\/ijeeee.2014.v4.347","article-title":"Challenges and Issues in Building Virtual Reality-Based E-Learning System","volume":"4","author":"Abdelaziz","year":"2014","journal-title":"Int. J. e-Education, e-Business, e-Management e-Learning."},{"key":"B3","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1016\/j.procs.2018.10.062","article-title":"A Rapid Prototyping Tool to Produce 360\u00b0 Video-Based Immersive Experiences Enhanced with Virtual\/multimedia Elements","volume":"138","author":"Ad\u00e3o","year":"2018","journal-title":"Proced. Comput. Sci."},{"key":"B4","volume-title":"A Pattern Language: Towns, Buildings, Construction","author":"Alexander","year":"1977"},{"key":"B5","doi-asserted-by":"publisher","first-page":"571","DOI":"10.5465\/amle.2008.35882197","article-title":"Learning on Demand, at Your Own Pace, in Rapid Bite-Sized Chunks: the Future Shape of Management Development?","volume":"7","author":"Armstrong","year":"2008","journal-title":"Amle."},{"key":"B6","doi-asserted-by":"publisher","first-page":"743","DOI":"10.1007\/s10845-016-1276-0","article-title":"Towards User Empowerment in Product Design: a Mixed Reality Tool for Interactive Virtual Prototyping","volume":"30","author":"Arrighi","year":"2019","journal-title":"J. Intell. Manuf."},{"key":"B7","first-page":"1","article-title":"Creating Augmented and Virtual Reality Applications: Current Practices, Challenges, and Opportunities","author":"Ashtari","year":"2020"},{"key":"B8","unstructured":"3ds max Batch Prooptimizer Description2021"},{"key":"B9","first-page":"113","article-title":"Panning for Gold: Designing Pedagogically Inspired Learning Nuggets","volume":"9","author":"Bailey","year":"2006","journal-title":"Educ. Technology Soc."},{"key":"B10","first-page":"61","article-title":"Learning Object Systems as Constructivist Learning Environments: Related Assumptions, Theories, and Applications","author":"Bannan-Ritland","year":"2002","journal-title":"The instructional use Learn. objects."},{"key":"B11","first-page":"167","article-title":"A Software Architecture for Adapting Virtual Reality Content to mobile Devices","author":"Barbosa Dias","year":"2010"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.5334\/2005-2","article-title":"Practical and Pedagogical Issues for Teacher Adoption of Ims Learning Design Standards in Moodle Lms","volume":"1","author":"Berggren","year":"2005","journal-title":"J. Interactive Media Education."},{"key":"B13","volume-title":"Pedagogical Patterns: Advice for Educators (Joseph Bergin Software Tools)","author":"Bergin","year":"2012"},{"key":"B14","first-page":"155","article-title":"3d Palette: a Virtual Reality Content Creation Tool","author":"Billinghurst","year":"1997"},{"key":"B15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1115\/1.4036921","article-title":"A Review of the Capabilities of Current Low-Cost Virtual Reality Technology and its Potential to Enhance the Design Process","volume":"17","author":"Coburn","year":"2017","journal-title":"J. Comput. Inf. Sci. Eng."},{"key":"B16","doi-asserted-by":"publisher","first-page":"19473","DOI":"10.1007\/s11042-019-7309-x","article-title":"Collaborative Immersive Authoring Tool for Real-Time Creation of Multisensory Vr Experiences","volume":"78","author":"Coelho","year":"2019","journal-title":"Multimed Tools Appl."},{"key":"B17","volume-title":"A Toolkit for Creating Effective Learning Activities","author":"Conole","year":"2005"},{"key":"B18","first-page":"486","article-title":"Alice: Lessons Learned from Building a 3d System for Novices","author":"Conway","year":"2000"},{"key":"B19","first-page":"135","article-title":"Surround-screen Projection-Based Virtual Reality: the Design and Implementation of the Cave","author":"Cruz-Neira","year":"1993"},{"key":"B20","first-page":"1","article-title":"A 3d Metaphor for Authoring Realtime Interactive Systems Supporting Different Author Roles","author":"D\u00f6rner","year":"2014"},{"key":"B21","article-title":"Conveying Firsthand Experience: The Circuit Parcours Technique for Efficient and Engaging Teaching in Courses about Virtual Reality and Augmented Reality","volume-title":"Eurographics 2021 - Education Papers","author":"D\u00f6rner","year":"2021"},{"key":"B22","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1007\/978-3-319-17043-5_11","article-title":"Content Creation and Authoring Challenges for Virtual Environments: from User Interfaces to Autonomous Virtual Characters","volume-title":"Virtual Realities","author":"D\u00f6rner","year":"2015"},{"key":"B23","doi-asserted-by":"publisher","first-page":"2609","DOI":"10.1016\/j.procs.2010.04.294","article-title":"Selection Methods for Interactive Creation and Management of Objects in 3d Immersive Environments","volume":"1","author":"Dunk","year":"2010","journal-title":"Proced. Computer Sci."},{"key":"B24","volume-title":"Immersive Authoring for Virtual Reality","author":"Dunk","year":"2013"},{"key":"B25","article-title":"Learning to Teach and Learning to Learn","author":"Eckstein","year":"2000"},{"key":"B26","unstructured":"Unreal Engine Description2021"},{"key":"B27","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1145\/262793.262798","article-title":"Object-oriented Application Frameworks","volume":"40","author":"Fayad","year":"1997","journal-title":"Commun. ACM."},{"key":"B28","doi-asserted-by":"publisher","first-page":"331","DOI":"10.5555\/336019.336029","article-title":"Analysis of Design: An Exploration of Patterns and Pattern Languages for Pedagogy","volume":"18","author":"Fincher","year":"1999","journal-title":"J. Comput. Mathematics Sci. Teach."},{"key":"B29","doi-asserted-by":"publisher","first-page":"3383","DOI":"10.1007\/s10639-020-10119-1","article-title":"The Challenges of Using Head Mounted Virtual Reality in K-12 Schools from a Teacher Perspective","volume":"25","author":"Fransson","year":"2020","journal-title":"Educ. Inf. Technol."},{"key":"B30","first-page":"1","article-title":"What You Sketch Is what You Get: Quick and Easy Augmented Reality Prototyping with Pintar","author":"Gasques","year":"2019"},{"key":"B31","first-page":"201","article-title":"D-flow: Immersive Virtual Reality and Real-Time Feedback for Rehabilitation","author":"Geijtenbeek","year":"2011"},{"key":"B32","first-page":"744","article-title":"Authoring Support for post-wimp Applications","author":"Gerken","year":"2013"},{"key":"B33","doi-asserted-by":"publisher","first-page":"82","DOI":"10.14742\/ajet.1344","article-title":"Educational Design and Networked Learning: Patterns, Pattern Languages and Design Practice","volume":"21","author":"Goodyear","year":"2005","journal-title":"Australas. J. Educ. Technol."},{"key":"B34","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1145\/126640.126677","article-title":"SIGGRAPH '90 Workshop Report: Software Architectures and Metaphors for Non-WIMP User Interfaces","volume":"25","author":"Green","year":"1991","journal-title":"SIGGRAPH Comput. Graph."},{"key":"B35","first-page":"2","article-title":"Amire-authoring Mixed Reality","author":"Grimm","year":"2002"},{"key":"B36","first-page":"187","article-title":"AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualit\u00e4t","author":"Hassenzahl","year":"2003"},{"key":"B37","first-page":"201","article-title":"Hedonic and Ergonomic Quality Aspects Determine a Software\u2019s Appeal","author":"Hassenzahl","year":"2000"},{"key":"B38","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1007\/978-3-319-68213-6_19","article-title":"The Thing and I: Understanding the Relationship between User and Product","volume-title":"Funology 2","author":"Hassenzahl","year":"2018"},{"key":"B39","first-page":"1","article-title":"Virtual Reality Forge: Pattern-Oriented Authoring of Virtual Reality Nuggets","author":"Horst","year":""},{"key":"B40","first-page":"137","article-title":"Integration of Bite-Sized Virtual Reality Applications into Pattern-Based Knowledge Demonstration","author":"Horst","year":""},{"key":"B41","first-page":"1","article-title":"Mining Virtual Reality Nuggets: A Pattern-Based Approach for Creating Virtual Reality Content Based on Microlearning Methodology","author":"Horst","year":""},{"key":"B42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11042-021-11317-w","article-title":"Back to Reality: Transition Techniques from Short Hmd-Based Virtual Experiences to the Physical World","author":"Horst","year":"","journal-title":"Multimedia Tools Appl."},{"key":"B43","article-title":"Design Patterns and Author Roles for Pattern-Based Educational Virtual Reality Experiences","author":"Horst","year":""},{"key":"B44","doi-asserted-by":"publisher","first-page":"947","DOI":"10.3897\/jucs.2020.051","article-title":"Bite-sized Virtual Reality Learning Applications: A Pattern-Based Immersive Authoring Environment","volume":"26","author":"Horst","year":"2020","journal-title":"jucs."},{"key":"B45","volume-title":"Virtual Reality Nuggets - Authoring and Usage of Concise and Pattern-Based Educational Virtual Reality Experiences. Ph.D. Thesis","author":"Horst","year":"2021"},{"key":"B46","first-page":"225","article-title":"Enacting Virtual Reality: The Philosophy and Cognitive Science of Optimal Virtual Experience","author":"Hovhannisyan","year":"2019"},{"key":"B47","article-title":"Micro Learning and Narration: Exploring Possibilities of Utilization of Narrations and Storytelling for the Design of \u201cMicro Units\u201d and Didactical Micro-learning Arrangements","author":"Hug","year":"2005"},{"key":"B48","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1109\/mc.2005.126","article-title":"Game Engine Virtual Reality with Caveut","volume":"38","author":"Jacobson","year":"2005","journal-title":"Computer."},{"key":"B49","doi-asserted-by":"publisher","first-page":"1515","DOI":"10.1007\/s10639-017-9676-0","article-title":"A Review of the Use of Virtual Reality Head-Mounted Displays in Education and Training","volume":"23","author":"Jensen","year":"2018","journal-title":"Educ. Inf. Technol."},{"key":"B50","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1145\/262793.262799","article-title":"Frameworks = (Components + Patterns)","volume":"40","author":"Johnson","year":"1997","journal-title":"Commun. ACM."},{"key":"B51","doi-asserted-by":"publisher","first-page":"2064","DOI":"10.1111\/bjet.12947","article-title":"Integrating Interactive Learner-Immersed Video-Based Virtual Reality into Learning and Teaching of Physical Geography","volume":"51","author":"Jong","year":"2020","journal-title":"Br. J. Educ. Technology."},{"key":"B52","first-page":"1","article-title":"Method for Developing Virtual Reality Applications for Cognitive Intensive Training Tasks","author":"Kemanji","year":"2020"},{"key":"B53","doi-asserted-by":"crossref","volume-title":"Learning Design A Handbook on Modelling and Delivering Networked Education and Training","author":"Koper","year":"2005","DOI":"10.5334\/2005-18"},{"key":"B54","first-page":"1","article-title":"Current Practices, Challenges, and Design Implications for Collaborative Ar\/vr Application Development","author":"Krau\u00df","year":"2021"},{"key":"B55","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1007\/s10055-018-0364-1","article-title":"Verification of the Possibility and Effectiveness of Experiential Learning Using Hmd-Based Immersive Vr Technologies","volume":"23","author":"Kwon","year":"2019","journal-title":"Virtual Reality."},{"key":"B56","first-page":"172","article-title":"Immersive Authoring of Tangible Augmented Reality Applications","author":"Lee","year":"2004"},{"key":"B57","volume-title":"Using the\u201d Thinking-Aloud\u201d Method in Cognitive Interface Design","author":"Lewis","year":"1982"},{"key":"B58","first-page":"21","article-title":"Content and Context: Designing and Developing Learning Objects","volume":"3","author":"Longmire","year":"2000","journal-title":"Learn. Without Limits."},{"key":"B59","first-page":"79","article-title":"\u00dcber kurz oder lang. ein schlichtungsversuch zur debatte \u00fcber micro-und macrolearning","author":"Lorenz","year":"2010"},{"key":"B60","first-page":"137","article-title":"Caveudk: a Vr Game Engine Middleware","author":"Lugrin","year":"2012"},{"key":"B61","first-page":"197","article-title":"Dart: a Toolkit for Rapid Design Exploration of Augmented Reality Experiences","author":"MacIntyre","year":"2004"},{"key":"B62","unstructured":"Thingiverse \u2013 Digital Design for Physical Objects2021"},{"key":"B63","first-page":"104","article-title":"Scratch: a Sneak Preview [education]","author":"Maloney","year":"2004"},{"key":"B64","unstructured":"A-frame Description\n MarcosD.\n McCurdyD.\n NgoK.\n 2021"},{"key":"B65","first-page":"451","article-title":"A Game-Engine Based Virtual Museum Authoring and Presentation System","author":"Mateevitsi","year":"2008"},{"key":"B66","first-page":"371","article-title":"Virtual Reality-Based Digital Reusable Learning Objects in Healthcare Training (Virdipa): 360\u00b0-video Trainings","author":"Meyer","year":"2020"},{"key":"B67","unstructured":"Box and Whisker Plot Documentation2021"},{"key":"B68","first-page":"1","article-title":"Xrdirector: A Role-Based Collaborative Immersive Authoring System","author":"Nebeling","year":"2020"},{"key":"B69","first-page":"333","article-title":"The Trouble with Augmented Reality\/virtual Reality Authoring Tools","author":"Nebeling","year":"2018"},{"key":"B70","first-page":"83","article-title":"Integration of Virtual Reality in Secondary Stem Education","author":"Nersesian","year":"2019"},{"key":"B71","first-page":"1497","article-title":"Sensory Effect Authoring Tool for Virtual Reality Simulation","author":"Park","year":"2018"},{"key":"B72","doi-asserted-by":"publisher","first-page":"785","DOI":"10.1037\/edu0000241","article-title":"Learning Science in Immersive Virtual Reality","volume":"110","author":"Parong","year":"2018","journal-title":"J. Educ. Psychol."},{"key":"B73","doi-asserted-by":"publisher","first-page":"463","DOI":"10.1007\/s11528-019-00401-6","article-title":"Learning to Teach with Virtual Reality: Lessons from One Elementary Teacher","volume":"63","author":"Patterson","year":"2019","journal-title":"TechTrends."},{"key":"B74","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/38.376600","article-title":"Alice: Rapid Prototyping System for Virtual Reality","volume":"15","author":"Pausch","year":"1995","journal-title":"IEEE Computer Graphics Appl."},{"key":"B75","article-title":"Use and Abuse of Reusable Learning Objects","volume":"3","author":"Polsani","year":"2003","journal-title":"J. Digital Inf."},{"key":"B76","first-page":"101","article-title":"The Arlab and Cave Libraries: On Authoring Augmented Reality and Virtual Reality Experiences Using a Graphical Programming Language","author":"Roth","year":"2011"},{"key":"B77","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1162\/pres.1994.3.2.130","article-title":"Depth of Presence in Virtual Environments","volume":"3","author":"Slater","year":"1994","journal-title":"Presence: Teleoperators & Virtual Environments."},{"key":"B78","doi-asserted-by":"publisher","first-page":"672","DOI":"10.4236\/ce.2014.59079","article-title":"Educational Microcontent for mobile Learning Virtual Environments","volume":"5","author":"Souza","year":"2014","journal-title":"Ce."},{"key":"B79","article-title":"Some Useful Abstractions for Re-usable Virtual Environment Platforms","author":"Steed","year":"2008"},{"key":"B80","first-page":"203","article-title":"Does a Gradual Transition to the Virtual World Increase Presence?","author":"Steinicke","year":"2009"},{"key":"B81","first-page":"94","article-title":"Ruis: A Toolkit for Developing Virtual Reality Applications with Spatial Interaction","author":"Takala","year":"2014"},{"key":"B82","unstructured":"Turbosquid 3d Model Source2021"},{"key":"B83","unstructured":"Unity Asset Store"},{"key":"B84","unstructured":"Unity Game Engine Description"},{"key":"B85","unstructured":"Attrakdiff Questionnaire2021"},{"key":"B86","unstructured":"Webxr Description2021"},{"key":"B87","first-page":"37","article-title":"A Software Application Framework for Developing Immersive Virtual Reality Experiences in Health Domain","author":"Wang","year":"2017"},{"key":"B88","first-page":"1","article-title":"Connecting Learning Objects to Instructional Design Theory: A Definition, a Metaphor, and a Taxonomy","volume":"2830","author":"Wiley","year":"2000","journal-title":"instructional use Learn. objects."},{"key":"B89","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1162\/pres.19.2.179","article-title":"Reflecting on the Design and Implementation Issues of Virtual Environments","volume":"19","author":"Wingrave","year":"2010","journal-title":"Presence: Teleoperators and Virtual Environments."}],"container-title":["Frontiers in Virtual Reality"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frvir.2022.840729\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T07:54:01Z","timestamp":1645775641000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frvir.2022.840729\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,25]]},"references-count":89,"alternative-id":["10.3389\/frvir.2022.840729"],"URL":"https:\/\/doi.org\/10.3389\/frvir.2022.840729","relation":{},"ISSN":["2673-4192"],"issn-type":[{"value":"2673-4192","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,25]]}}}