Abstract
Aircraft maintenance is a critical success factor in the aviation sector, and incorrect maintenance actions themselves can be the cause of accidents. Judgemental errors are the top causal factors of maintenance-related aviation accidents. This study asks why judgemental errors occur in maintenance. Referring to six aviation accidents, we show how various biases contributed to those accidents. We first filtered aviation accident reports, looking for accidents linked to errors in maintenance judgements. We analysed the investigation reports, as well as the relevant interview transcriptions. Then we set the characteristics of the actions behind the accidents within the context of the literature and the taxonomy of reasons for judgemental biases. Our results demonstrate how various biases, such as theory-induced blindness, optimistic bias, and substitution bias misled maintenance technicians and eventually become the main cause of a catastrophe. We also find these biases are interrelated, with one causing another to develop. We discuss how these judgemental errors could relate to loss of situation awareness, and suggest interventions to mitigate them.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Almutairi AF, Gardner GE, McCarthy A (2014) Practical guidance for the use of a pattern-matching technique in case-study research: a case presentation. Nurs Health Sci 16(2):239–244
Arnott D (1998) A taxonomy of decision biases. Monash University, School of Information Management and Systems, Caulfield
Arnott DR (2006) Cognitive biases and decision support systems development: a design science approach. Inf Syst J 16:55–78
Baddeley M (2015) Herding, social influences and behavioural bias in scientific research. EMBO reports 1;16(8):902-5
Bauer M (2000) Classical content analysis: a review. In Bauer MW, Gaskell G Qualitative researching with text, image and sound. SAGE Publications Ltd, London, pp 132–151. https://doi.org/10.4135/9781849209731
Baybutt P (2016) Cognitive biases in process hazard analysis. J Loss Prev Process Ind 1(43):372–377
Brooks B, Curnin S, Owen C, Bearman C (2019) Managing cognitive biases during disaster response: the development of an aide memoire. Cognition, Technology & Work, pp 1–3
Chen T (2017) Not just noise: individual differences in cognitive ability and response bias. Dissertations, University of Massachusetts, Amherst
Dobler CC, Morrow AS, Kamath CC (2019) Clinicians’ cognitive biases: a potential barrier to implementation of evidence-based clinical practice. BMJ Evid-Based Med 24:137–140
Doyle JR (2013) Survey of time preference, delay discounting models. Judgm Decision Mak 8(2):116–135
Dube C, Rotello CM, Heit E (2010) Assessing the belief bias effect with ROCs: it’s a response bias effect. Psychol Rev 117(3):831–863. https://doi.org/10.1037/a0019634
East R (2016) Bias in the evaluation of research methods. Mark Theory 16(2):219–231
Endsley MR (1988) Design and evaluation for situation awareness enhancement. In: Proceedings of the human factors society 32nd annual meeting, human factors society, Santa Monica, pp 97–101
Endsley MR (1995) Toward a theory of situation awareness in dynamic systems. Hum Factors 37(1):32–64
Endsley MR (2000) Theoretical underpinnings of situation awareness: a critical review. In: Endsley MR, Garland DJ (eds) Situation awareness analysis and measurement, Mahwah, NJ, pp 3–32
Endsley MR (2004) Situation awareness: progress and directions. In: Banbury S, Tremblay S (eds) A cognitive approach to situation awareness: theory, measurement and application. Ashgate Publishing, Aldershot, pp 317–341
Endsley MR (2015) Situation awareness misconceptions and misunderstandings. J Cogn Eng Decision Mak 9(1):4–32
Endsley MR, Jones DG (2012) Designing for situation awareness: an approach to human-centered design, 2nd edn. Taylor & Francis, London
Festinger L (1962) Cognitive dissonance. Sci Am 207(4):93–106
Fischhoff B (1982) Debiasing. In: Kahneman D, Slovic P, Tversky A (eds) Judgment under uncertainty: Heuristics and biases Cambridge. Cambridge University Press, England, pp 422–444
Gauffroy C, Barrouillet P (2009) Heuristic and analytic processes in mental models for conditionals: an integrative developmental theory. Dev Rev 29:249–282
Gerring J, Cojocaru L (2016) Case-selection: a diversity of methods and criteria. Sociol Methods Res 4:392–423
Getzmann S, Jasny J, Falkenstein M (2016) Switching of auditory attention in “cocktail-party” listening: ERP evidence of cueing effects in younger and older adults. Brain Cogn 111:1–12. https://doi.org/10.1016/j.bandc.2016.09.006
Gigerenzer G, Todd P (1999) Simple heuristics that make us smart. Oxford Univ. Press, Oxford
Gigerenzer G, Hoffrage U, Goldstein DG (2008) Postscript: fast and frugal heuristics. Psychol Rev 115(1):238–239
Griffin D, Tversky A (1992) The weighing of evidence and the determinants of confidence. Cogn Psychol 24(3):411–435
Illankoon P, Abeysekera J, Singh S (2016) Ergonomics for enhancing detection of machine abnormalities. Work 55(2):271–280
Illankoon P, Tretten P, Kumar U (2018) Identifying significance of human cognition in future maintenance operations. In: International conference on intelligent human systems integration. Springer, Cham, pp 550–556
Illankoon P, Manathunge Y, Tretten P, Abeysekara J, Singh S (2019a) Lockout and tagout in a manufacturing setting from a situation awareness perspective. Safety 5(2):25
Illankoon P, Tretten P, Kumar U (2019b) A prospective study of maintenance deviations using HFACS–ME. Int J Ind Ergon. https://doi.org/10.1016/j.ergon.2019.102852
Illankoon P, Tretten P, Kumar U (2019c) Modelling human cognition of abnormal machine behaviour. Hum-Intell Syst Integr 1:3. https://doi.org/10.1007/s42454-019-00002-x
Kahneman D (2011) Thinking, fast and slow. Macmillan, London
Kahneman D, Frederick S (2002) Representativeness revisited: attribute substitution in intuitive judgment. Heuristics Biases Psychol Intuitive Judgm 49:81
Kahneman D, Klein G (2009) Conditions for intuitive expertise: a failure to disagree. Am Psychol 80:237–251
Kahneman D, Slovic P, Tversky A (1982) Judgment under uncertainty: heuristics and biases. Cambridge University Press, Cambridge. https://doi.org/10.1017/cbo9780511809477
Kelly TP, Lam W, Whittle BR (1996) Diary of a domain analyst: a domain analysis case-study from avionics. In: Proceedings of IFIP Working Groups 8.1/13.2 Conference, Domain Knowledge for Interactive System Design, Geneva, pp 8–10
Kinsey MJ, Gwynne SM, Kuligowski ED, Kinateder M (2019) Cognitive biases within decision making during fire evacuations. Fire Technol 55(2):465–485
Klein G (2008) Naturalistic decision making. Hum Factors 50(3):456–460
Krulak DC (2004) Human factors in maintenance: impact on aircraft mishap frequency and severity. Aviat Space Environ Med 75:429–432
Lewis-Beck MS, Bryman A, Futing Liao T (2004) The SAGE encyclopedia of social science research methods. Sage Publications, Thousand Oaks. https://doi.org/10.4135/9781412950589
Liu P, Du Y, Xu Z (2019) Machines versus humans: people’s biased responses to traffic accidents involving self-driving vehicles. Accid Anal Prev 1(125):232–240
Mack A, Rock I (1999) Inattentional blindness. MIT Press, Cambridge
Marewski JN, Gaissmaier W, Gigerenzer G (2010) Good judgments do not require complex cognition. Cogn Process 11(2):103–121
Mills AJ, Durepos G, Wiebe E (2010) Encyclopedia of case study research (Vols. 1–0). SAGE Publications, Thousand Oaks. https://doi.org/10.4135/9781412957397
Mittal SK (2019) Behavior biases and investment decision: theoretical and research framework. Qual Res Financ Markets. https://doi.org/10.1108/QRFM-09-2017-0085
Moray NA (1990) Lattice theory approach to the structure of mental models. Philos Trans R Soc Lond Biol Sci 327(1241):577–583
Murata A, Nakamura T, Karwowski W (2015) Influence of cognitive biases in distorting decision making and leading to critical unfavorable incidents. Safety 1(1):44–58
Nelson GS (2019) Bias in artificial intelligence. N C Med J 80(4):220–222
NTSB (2002) Accident Report NTSB/AAR-02/01, PB2002-910402. https://www.ntsb.gov/investigations/AccidentReports/Reports/AAR0201.pdf. Accessed 14 Nov 2018
NTSB (2004) Accident Report NTSB/AAR-04/01, PB2004-910401. https://www.ntsb.gov/investigations/AccidentReports/Reports/AAR0401.pdf. Accessed 11 Feb 2019
NTSB (2007) Accident Report NTSB/AAR-07/04, PB2007-910405. https://www.ntsb.gov/investigations/AccidentReports/Reports/AAR0704.pdf. Accessed 27 Nov 2018
NTSB (2009a) Accident Report NTSB/AAR-09/03, PB2009-910403. https://www.ntsb.gov/investigations/AccidentReports/Reports/AAR0903.pdf. Accessed 16 Jan 2019
NTSB (2009b) Accident Report NTSB/AAR-09/01/SUM, PB2009-910401. https://www.ntsb.gov/investigations/AccidentReports/Reports/AAR0901.pdf. Accessed 16 Nov 2018
NTSB (2013) Accident Report NTSB/AAR-13/01, PB2013-103890. https://www.ntsb.gov/investigations/AccidentReports/Reports/AAR1301.pdf. Accessed 27 Nov 2018
Onwuegbuzie AJ, Leech NL, Collins KM (2012) Qualitative analysis techniques for the review of the literature. Qualitative Report 17(56):1–28. http://www.nova.edu/ssss/QR/QR17/onwuegbuzie.pdf. Accessed 5 Dec 2018
O’Regan JK, Rensink RA, Clark JJ (1999) Change-blindness as a result of “mudsplashes”“. Nature 398(6722):34. https://doi.org/10.1038/17953
Peón D, Antelo M, Calvo-Silvosa A (2017) An inclusive taxonomy of behavioral biases. Eur J Gov Econ 6(1):24–58. https://doi.org/10.17979/ejge.2017.6.1.4322
Plant KL, Stanton NA (2013) The explanatory power of schema theory: theoretical foundations and future applications in Ergonomics. Ergonomics 56(1):1–15
Rabin M, Schrag J (1999) First impressions matter: a model of confirmatory bias. Quart J Econ 114(1):37–82. https://doi.org/10.1162/003355399555945
Rashid HSJ, Place CS, Braithwaite GR (2013) Investigating the investigations: a retrospective study in the aviation maintenance error causation. Cogn Technol Work 15:171. https://doi.org/10.1007/s10111-011-0210-7
Rasmussen J (1983) Skills, rules, and knowledge; signals, signs and symbols, and other distinctions in human performance models. IEEE Trans Sys Man Cybern 13:257–266
Reason J, Hobbs A (2003) Managing maintenance error: a practical guide. Ashgate Publishing Company, Burlington
Ryan A, Duignan S, Kenny D, McMahon CJ (2018) Decision making in paediatric cardiology. Are we prone to heuristics, biases and traps?. Pediatric cardiology 1;39(1):160-7
Sarter NB, Woods DD (1991) Situation awareness: a critical but ill-defined phenomenon. Int J Aviation Psychol 1(1):45–57
Schmidt JK, Figlock RC, Teeters CD (1999) Human factors analysis of naval transport aircraft maintenance and flight line related incidents (No. 1999-01-2981). SAE Technical Paper
Schmidt J, Schmorrow D, Figlock R (2000) Human factors analysis of naval aviation maintenance related mishaps. Proc Hum Factors Ergon Soc Annu Meeting 44(22):775–778
Schmidt JK, Lawson D, Figlock R (2003) Human Factors Analysis & Classification System–Maintenance Extension (HFACS–ME) Review of Select NTSB Maintenance Mishaps: An Update
Schoenlein M (2017) Assessing the Relationship Between Change Blindness and the Anchoring Effect. Honors Projects. 245. https://scholarworks.bgsu.edu/honorsprojects/245. Accessed 5 Mar 2019
Stake RE (2000) Case studies. In: Denzin NK, Lincoln YS (eds) Handbook of qualitative research. Sage, Thousand Oaks, pp 435–453
Taylor J (2016) Cognitive biases are bad for business: industry insights. Prof Account 1(27):24–25
Tversky A, Kahneman D (1971) The belief in the law of small numbers. Psychol Bull 76(2):105–110. https://doi.org/10.1037/h0031322
Tversky A, Kahneman D (1974) Judgment under Uncertainty: heuristics and Biases. Science 185(4157):1124–1131 (New Series)
Tversky A, Kahneman D (1991) Loss aversion in riskless choice: a reference-dependent model. Q J Econ 106(4):1039–1061. https://doi.org/10.2307/2937956
Vanderhaegen F (2017) Towards increased systems resilience: new challenges based on dissonance control for human reliability in Cyber-Physical & Human Systems. Annu Rev Control 1(44):316–322
Vanderhaegen F, Carsten O (2017) Can dissonance engineering improve risk analysis of human–machine systems? Cogn Tech Work 19:1–12. https://doi.org/10.1007/s10111-017-0405-7
Virine L, Trumper M, Virine E (2018) Heuristics and biases in project management. PM World J 7(1):1–11
Wattanacharoensil W, La-ornual D (2019) A systematic review of cognitive biases in tourist decisions. Tour Manag 1(75):353–369
Weick K (1993) Sensemaking in organizations: small structures with large consequences. In: Mumingham J (ed) Social psychology in organizations: Advances in theory and research. Prentice-Hall, Englewood Cliffs, NJ
Wickens TD (2002) Elementary signal detection theory. Oxford University Press, Oxford
Wickens CD, Parasuraman R, Simon B, Hollands JG (2015) Engineering psychology and human performance, 4th edn. Routledge, London
Wood G (1978) The knew-it-all-along effect. J Exp Psychol Hum Percept Perform 4:345–353
Yin RK (2009) Case study research: design and methods, 4th edn. Sage, Thousand Oaks
Zhang SX, Cueto J (2017) The study of bias in entrepreneurship. Entrep Theory Pract 41(3):419–454
Acknowledgements
Open access funding provided by Lulea University of Technology. This project is a part of the human factors research at the Division of Operations and Maintenance, Luleå University of Technology, funded by the Luleå Railway Research Centre (JVTC).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Illankoon, P., Tretten, P. Judgemental errors in aviation maintenance. Cogn Tech Work 22, 769–786 (2020). https://doi.org/10.1007/s10111-019-00609-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10111-019-00609-9