A use case study comparing augmented reality (AR) and electronic document-based maintenance instructions considering tasks complexity and operator competency level | Virtual Reality Skip to main content
Springer Nature Link
Log in

A use case study comparing augmented reality (AR) and electronic document-based maintenance instructions considering tasks complexity and operator competency level

  • Original Article
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

Augmented reality (AR) is more and more used in the industrial context for maintenance, assembly operation. However, owing to the evolution and maturity of the technology, it is still necessary to evaluate the usage and benefits of AR in an industrial context to go further than proof of concept. As such, this paper proposes an analysis of AR case study in the literature. Then, this paper presents a methodology for comparing AR and electronic document-based complex maintenance instructions considering tasks complexity and operator competency level. The main results show that the consultation duration of the AR tablet is 34% statistically faster than the PDF tablet. It also shows that error concerning similar objects is reduced thanks to AR. Moreover, the study specifically focuses on types of task that worth using AR. However, the study shows that usability of the AR device is less well rated than the PDF for “beginner–intermediate” operators. Finally, an in-depth analysis permits extracting recommendations of the different factors to take into account with industrial AR applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  • Aromaa S, Väätänen A, Hakkarainen M, Kaasinen E (2018) User experience and user acceptance of an augmented reality based knowledge-sharing solution in industrial maintenance work. Springer International Publishing, Cham, pp 145–156. https://doi.org/10.1007/978-3-319-60492-3_14 ISBN: 978-3-319-60492-3

    Book  Google Scholar 

  • Bangor A, Kortum P, Miller J (2009) Determining what individual SUS scores mean: adding an adjective rating scale. J Usability Stud 4(3):114–123

    Google Scholar 

  • Bottecchia S (2010) Système TAC: Télé-Assistance Collaborative. Réalité augmentée et NTIC au service des opérateurs et des experts dans le cadre d’une tâche de maintenance industrielle supervisée. Ph.D. thesis, Université Paul Sabatier-Toulouse III

  • Bottecchia S, Cieutat J-M, Jessel J-P (2010) TAC: augmented reality system for collaborative tele-assistance in the field of maintenance through internet. In: Proceedings of the 1st augmented human international conference. ACM, pp 14

  • Chu C-H, Liao C-J, Lin S-C (2020) Comparing augmented reality-assisted assembly functions—a case study on Dougong structure. Appl Sci 10(1010):3383. https://doi.org/10.3390/app10103383 ISSN: 2076-3417

    Article  Google Scholar 

  • de Souza Cardoso LF, Mariano FCMQ, Zorzal ER (2020) Mobile augmented reality to support fuselage assembly. Comput Ind Eng 148:106712. https://doi.org/10.1016/j.cie.2020.106712 ISSN: 03608352

    Article  Google Scholar 

  • Deshpande A, Kim I (2018) The effects of augmented reality on improving spatial problem solving for object assembly. Adv Eng Inform 38:760–775. https://doi.org/10.1016/j.aei.2018.10.004 ISSN: 14740346

    Article  Google Scholar 

  • Didier J-Y, Roussel D, Mallem M, Otmane S, Naudet S, Pham Q-C, Bourgeois S, Mégard C, Leroux C, Hocquard A (2005) Amra: augmented reality assistance for train maintenance tasks. In: Workshop industrial augmented reality, 4th ACM/IEEE international symposium on mixed and augmented reality (ISMAR 2005), pages Elect–Proc

  • Fiorentino M, Uva AE, Gattullo M, Debernardis S, Monno G (2014) Augmented reality on large screen for interactive maintenance instructions. Comput Ind 65(22):270–278. https://doi.org/10.1016/j.compind.2013.11.004 ISSN: 01663615

    Article  Google Scholar 

  • Friedrich W, Jahn D, Schmidt L (2002) Arvika-augmented reality for development, production and service. In: ISMAR, vol 2002, pp 3–4. Citeseer

  • Funk M (2016) Augmented reality at the workplace: a context-aware assistive system using in-situ projection

  • Funk M, Kosch T, Greenwald SW, Schmidt A (2015) A benchmark for interactive augmented reality instructions for assembly tasks. In: Proceedings of the 14th international conference on mobile and ubiquitous multimedia. ACM, pp 253–257 https://doi.org/10.1145/2836041.2836067. http://thomaskosch.com/wp-content/plugins/papercite/pdf/funk2015gatm.pdf

  • Funk M, Kosch T, Schmidt A (2016a) Interactive worker assistance: comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions. In: Proceedings of the 2016 ACM international joint conference on pervasive and ubiquitous computing. ACM, pp 934–939

  • Funk M, Mayer S, Nistor M, Schmidt A (2016b) Mobile in-situ pick-by-vision: Order picking support using a projector helmet. In: Proceedings of the 9th ACM international conference on PErvasive technologies related to assistive environments. ACM, pp 45

  • Gattullo M, Scurati GW, Fiorentino M, Uva AE, Ferrise F, Bordegoni M (2019) Towards augmented reality manuals for industry 4.0: a methodology. Robot Comput Integr Manuf 56:276–286. https://doi.org/10.1016/j.rcim.2018.10.001 ISSN: 07365845

    Article  Google Scholar 

  • Gonzalez-Franco M, Cermeron J, Li K, Pizarro R, Thorn J, Hannah P, Hutabarat W, Tiwari A, Bermell-Garcia P (2016) Immersive augmented reality training for complex manufacturing scenarios. arXiv preprint arXiv:1602.01944

  • Hart SG (2006) Nasa-task load index (nasa-tlx); 20 years later. In: Proceedings of the human factors and ergonomics society annual meeting, vol 50. Sage Publications Sage CA, Los Angeles, CA, pp 904–908. http://apps.usd.edu/coglab/schieber/psyc792/workload/Hart_HFES_20006.pdf

  • Hart SG, Staveland LE (1988) Development of NASA-TLX (task load index): results of empirical and theoretical research. Adv Psychol 52:139–183

    Article  Google Scholar 

  • Havard V, Baudry D, Savatier X, Jeanne B, Louis A, Mazari B (2016) Augmented industrial maintenance (AIM): a case study for evaluating and comparing with paper and video media supports. In: International conference on augmented reality, virtual reality and computer graphics. Springer, pp 302–320

  • Henderson S, Feiner S (2011) Exploring the benefits of augmented reality documentation for maintenance and repair. IEEE Trans Vis Comput Gr 17(10):1355–1368

    Article  Google Scholar 

  • Herter J (2014) Augmented reality supported order picking using projected user interfaces. B.S. thesis

  • Hinterstoisser S, Lepetit V, Rajkumar N, Konolige K (2016) Going further with point pair features

  • Hoover M (2018) An evaluation of the microsoft hololens for a manufacturing-guided assembly task https://lib.dr.iastate.edu/cgi/viewcontent.cgi?article=7385&context=etd

  • Koch C, Neges M, König M, Abramovici M (2014) Performance study on natural marker detection for augmented reality supported facility maintenance. In: Australasian journal of construction economics and building-conference series, vol 2. CUTSePRESS, pp 23–34

  • Lai Z-H, Tao W, Leu MC, Yin Z (2020) Smart augmented reality instructional system for mechanical assembly towards worker-centered intelligent manufacturing. J Manuf Syst 55:69–81. https://doi.org/10.1016/j.jmsy.2020.02.010 ISSN: 02786125

    Article  Google Scholar 

  • Lamberti F, Manuri F, Sanna A, Paravati G, Pezzolla P, Montuschi P (2014) Challenges, opportunities and future trends of emerging techniques for augmented reality-based maintenance. Trans Emerg Top Comput

  • Likert R (1932) A technique for the measurement of attitudes. Arch Psychol

  • Masood T, Egger J (2019) Augmented reality in support of industry 4.0-implementation challenges and success factors. Robot Comput Integr Manuf 58:181–195. https://doi.org/10.1016/j.rcim.2019.02.003 ISSN: 07365845

    Article  Google Scholar 

  • Mechin B (2007) Maintenance: concepts et définitions. Ed. Techniques Ingénieur

  • Moragues M, James O, Marine P, Thierry G, Thouin-Bousquié J, Maillard C, Bergounhoux J (2017) L’industrie joue avec la réalité

  • Mourtzis D, Zogopoulos V, Xanthi F (2019) Augmented reality application to support the assembly of highly customized products and to adapt to production re-scheduling. Int J Adv Manuf Technol 105(99):3899–3910. https://doi.org/10.1007/s00170-019-03941-6 ISSN: 0268-3768, 1433–3015

    Article  Google Scholar 

  • Nee A, Ong S, Chryssolouris G, Mourtzis D (2012) Augmented reality applications in design and manufacturing. CIRP Ann Manuf Technol 61(2):657–679

    Article  Google Scholar 

  • Nielsen J (1994) Usability engineering. Elsevier, Amsterdam

    MATH  Google Scholar 

  • Palmarini R, Erkoyuncu JA, Roy R, Torabmostaedi H (2018) A systematic review of augmented reality applications in maintenance. Robot Comput Integr Manuf 49:215–228. https://doi.org/10.1016/j.rcim.2017.06.002 ISSN: 07365845

    Article  Google Scholar 

  • Polvi J, Taketomi T, Moteki A, Yoshitake T, Fukuoka T, Yamamoto G, Sandor C, Kato H (2018) Handheld guides in inspection tasks: augmented reality versus picture. IEEE Trans Vis Comput Gr 24(7):2118–2128. https://doi.org/10.1109/TVCG.2017.2709746 ISSN: 1077-2626

    Article  Google Scholar 

  • Radkowski R (2016) Object tracking with a range camera for augmented reality assembly assistance. J Comput Inf Sci Eng 16(1):011004

    Article  Google Scholar 

  • Suàrez-Warden F, Mendìvil EG, Rodrìguez CA, Garcia-Lumbreras S (2015) Assembly operations aided by augmented reality: an endeavour toward a comparative analysis. Procedia Comput Sci 75:281–290

    Article  Google Scholar 

  • Syberfeldt A, Danielsson O, Holm M, Wang L (2015) Visual assembling guidance using augmented reality. Procedia Manuf 1:98–109

    Article  Google Scholar 

  • Tamaazousti M (2013) L’ajustement de faisceaux contraint comme cadre d’unification des méthodes de localisation: application à la réalité augmentée sur des objets 3D. Ph.D. thesis, Université Blaise Pascal-Clermont-Ferrand II

  • Uva AE, Gattullo M, Manghisi VM, Spagnulo D, Cascella GL, Fiorentino M (2018) Evaluating the effectiveness of spatial augmented reality in smart manufacturing: a solution for manual working stations. Int J Adv Manuf Technol 94(1–41–4):509–521. https://doi.org/10.1007/s00170-017-0846-4 ISSN: 0268-3768, 1433–3015

    Article  Google Scholar 

  • Vanneste P, Huang Y, Park JY, Cornillie F, Decloedt B, Van den Noortgate W (2020) Cognitive support for assembly operations by means of augmented reality: an exploratory study. Int J Hum Comput Stud 143:102480. https://doi.org/10.1016/j.ijhcs.2020.102480 ISSN: 10715819

    Article  Google Scholar 

  • Wang X, Ong S, Nee A (2016) Multi-modal augmented-reality assembly guidance based on bare-hand interface. Adv Eng Inf 30(33):406–421. https://doi.org/10.1016/j.aei.2016.05.004 ISSN: 14740346

    Article  Google Scholar 

  • Wang X, Ong S, Nee A (2016b) A comprehensive survey of augmented reality assembly research. Adv Manuf 4(1):1–22

  • Westerfield G, Mitrovic A, Billinghurst M (2015) Intelligent augmented reality training for motherboard assembly. Int J Artif Intell Educ 25(1):157–172

    Article  Google Scholar 

  • Xiang Y, Schmidt T, Narayanan V, Fox D (2017) Posecnn: A convolutional neural network for 6d object pose estimation in cluttered scenes. arXiv preprint arXiv:1711.00199

  • Zhu J, Ong S, Nee A (2013) An authorable context-aware augmented reality system to assist the maintenance technicians. Int J Adv Manuf Technol 66(9–12):1699–1714

    Google Scholar 

Download references

Acknowledgements

This part of the work is done within the framework of the project “PFPI PlateForme de Performances Industrielles” (Industrial Performance Platform) and financed by the FEDER and the Normandy region.

Author information

Authors and Affiliations

  1. LINEACT, CESI, 80 rue Edmund Halley, 76808, Saint-Étienne-du-Rouvray, France

    Vincent Havard, David Baudry, Benoit Jeanne & Anne Louis

  2. IRSEEM, ESIGELEC, Avenue Galilée, BP 10024, 76801, Saint-Étienne-du-Rouvray, France

    Xavier Savatier

Authors
  1. Vincent Havard
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. David Baudry
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Benoit Jeanne
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Anne Louis
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Xavier Savatier
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Vincent Havard.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Havard, V., Baudry, D., Jeanne, B. et al. A use case study comparing augmented reality (AR) and electronic document-based maintenance instructions considering tasks complexity and operator competency level. Virtual Reality 25, 999–1014 (2021). https://doi.org/10.1007/s10055-020-00493-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-020-00493-z

Keywords