Abstract
Human performance is of paramount importance in aircraft piloting. The ability to perform the required flying tasks under stressful conditions is critical. However, unexpected or threatening events have the potential to trigger a startle reflex, a phenomenon that can lead to cognitive incapacitation and potentially catastrophic accidents. Few studies have examined brain activity following a startle reflex, especially during a complex cognitive task. We conducted an experiment in which we induced a startle reflex using loud acoustic stimuli while participants were engaged in the Toulouse n-back task (engaging memory processes and mental calculation). During the task, brain measures were obtained using functional near-infrared spectroscopy (fNIRS) and facial temperature was recorded using a thermal camera. Our initial findings reveal that the startle reflex has been successfully induced, as demonstrated by the observable behavioral reactions captured in the camera recordings. After experiencing the startle reflex, participants showed a brief decrease in task performance, suggesting a momentary disruption of cognitive processes, highlighting the potential implications of the startle reflex for aviation safety. The integration of multimodal physiological techniques will allow us to comprehensively investigate both cerebral and peripheral physiological responses during the startle reflex. Our research will contribute to the understanding of how startle responses can affect cognitive performance and shed light on the potential cognitive incapacitation that may result from this phenomenon.
J. Neubert, F. Schwartz and M. Causse—These authors contributed equally to this work.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bolivariano, G.: Rapport final West Caribbean Airways DC-9-82 (MD-82) Immatricule HK4374X Machiques, Venezuela 16 AO\(\hat{\text{U}}\)T 2005. Accident report JIAAC-9-058-2005, Ministerio del Poder Popular para Transporte y Comunicaciones (2005). https://bea.aero/docspa/2005/hk-x050816/pdf/hk-x050816.pdf. Accessed 26 Jan 2024
NTSB: Loss of Control on Approach Colgan Air, Inc. Operating as Continental Connection Flight 3407. Accident report NTSB/AAR-10/01 PB2010-910401, National Transportation Safety Board, 490 L’Enfant Plaza, S.W.Washington, D.C. 20594 (2010). https://www.ntsb.gov/investigations/accidentreports/reports/aar1001.pdf. Accessed 21 Jan 2024
Blumenthal, T.D., Goode, C.T.: The startle eyeblink response to low intensity acoustic stimuli. Psychophysiology 28(3), 296–306 (1991). https://doi.org/10.1111/j.1469-8986.1991.tb02198.x. https://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1469-8986.1991.tb02198.x. Accessed 25 Jan 2024
Eaton, R.C.: Neural Mechanisms of Startle Behavior. Springer, Heidelberg (2013)
Simons, R.C.: Boo!: Culture, Experience, and the Startle Reflex. Oxford University Press, Oxford (1996)
Yeomans, J.S., Frankland, P.W.: The acoustic startle reflex: neurons and connections. Brain Res. Rev. 21(3), 301–314 (1995). https://doi.org/10.1016/0165-0173(96)00004-5. Accessed 2024-01-24
Martin, W.L., Murray, P.S., Bates, P.R.: The effects of startle on pilots during critical events: a case study analysis. In: Proceedings of 30th EAAP Conference: Aviation Psychology & Applied Human Factors, pp. 387–394 (2012)
Landis, C., Hunt, W.A.: The startle pattern. J. Mental Sci. 85(357), 808–809 (1939). https://doi.org/10.1192/bjp.85.357.808-b. Accessed 26 Jan 2024
LeDoux, J.E.: The Emotional Brain: The Mysterious Underpinnings of Emotional Life, p. 384. Simon & Schuster, New York (1996)
Hamm, A.O.: Fear-potentiated startle. In: Wright, J.D. (ed.) International Encyclopedia of the Social & Behavioral Sciences, 2nd edn., pp. 860-867. Elsevier, Oxford (2015). https://doi.org/10.1016/B978-0-08-097086-8.55023-5. https://www.sciencedirect.com/science/article/pii/B9780080970868550235
Asli, O., Flaten, M.A.: In the blink of an eye: investigating the role of awareness in fear responding by measuring the latency of startle potentiation. Brain Sci. 2(1), 61–84 (2012). https://doi.org/10.3390/brainsci2010061. Accessed 25 Jan 2024
Thackray, R.I.: Performance recovery following startle: a laboratory approach to the study of behavioral response to sudden aircraft emergencies: (586272011–001). American Psychological Association (1988). https://doi.org/10.1037/e586272011-001. http://doi.apa.org/get-pe-doi.cfm?doi=10.1037/e586272011-001. Accessed 03 Aug 2022
Lang, P.J., Bradley, M.M., Cuthbert, B.N.: Emotion, attention, and the startle reflex. Psychol. Rev. 97(3), 377–395 (1990). https://doi.org/10.1037/0033-295X.97.3.377
Corr, P.J., et al.: Personality and affective modulation of the startle reflex. Pers. Individ. Differ. 19(4), 543–553 (1995). https://doi.org/10.1016/0191-8869(95)00059-F. Accessed 25 Jan 2024
Blanch, A., Lucas, I., Balada, F., Blanco, E., Aluja, A.: Sex differences and personality in the modulation of the acoustic startle reflex. Physiol. Behav. 195, 20–27 (2018). https://doi.org/10.1016/j.physbeh.2018.07.020. Accessed 25 Jan 2024
Hamm, A.O., Cuthbert, B.N., Globisch, J., Vaitl, D.: Fear and the startle reflex: Blink modulation and autonomic response patterns in animal and mutilation fearful subjects. Psychophysiology 34(1), 97–107 (1997) https://doi.org/10.1111/j.1469-8986.1997.tb02420.x. https://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1469-8986.1997.tb02420.x. Accessed 26 Jan 2024
Oskarsson, S., Patrick, C.J., Siponen, R., Bertoldi, B.M., Evans, B., Tuvblad, C.: The startle reflex as an indicator of psychopathic personality from childhood to adulthood: a systematic review. Acta Psychologica 220, 103427 (2021). https://doi.org/10.1016/j.actpsy.2021.103427. Accessed 25 Jan 2024
Grillon, C., Baas, J.: A review of the modulation of the startle reflex by affective states and its application in psychiatry. Clin. Neurophysiol. 114(9), 1557–1579 (2003). https://doi.org/10.1016/S1388-2457(03)00202-5. Accessed 25 Jan 2024
Corbetta, M., Shulman, G.L.: Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 3(3), 201–215 (2002). https://doi.org/10.1038/nrn755. Accessed 29 Jan 2024
Niendam, T.A., Laird, A.R., Ray, K.L., Dean, Y.M., Glahn, D.C., Carter, C.S.: Metaanalytic evidence for a superordinate cognitive control network subserving diverse executive functions. Cogn. Affect. Behav. Neurosci. 12(2), 241–268 (2012). https://doi.org/10.3758/s13415-011-0083-5. Accessed 26 Jan 2024
Shen, K.-K., et al.: Structural core of the executive control network: A high angular resolution diffusion MRI study. Human Brain Mapp. 41(5), 1226–1236 (2020). https://doi.org/10.1002/hbm.24870. https://onlinelibrary.wiley.com/doi/pdf/10.1002/hbm.24870. Accessed 26 Jan 2024
Causse, M., et al.: Facing successfully high mental workload and stressors: an fMRI study. Hum. Brain Mapp. 43(3), 1–21 (2021). https://doi.org/10.1002/hbm.25703. Accessed 29 Jan 2024
Hermans, E.J., Henckens, M.J.A.G., Joëls, M., Fernández, G.: Dynamic adaptation of large-scale brain networks in response to acute stressors. Trends Neurosci. 37(6), 304–314 (2014). https://doi.org/10.1016/j.tins.2014.03.006. Accessed 26 Jan 2024
Causse, M., Mouratille, D., Rouillard, Y., El Yagoubi, R., Matton, N., Hidalgo, A.: How a pilot’s brain copes with stress and mental load? insights from the executive control network, Rochester, NY (2023). https://doi.org/10.2139/ssrn.4392279. https://papers.ssrn.com/abstract=4392279 Accessed 29 Jan 2024
Arnsten, A.F.T.: Stress signalling pathways that impair prefrontal cortex structure and function. Nat. Rev. Neurosci. 10(6), 410–422 (2009). https://doi.org/10.1038/nrn2648. Accessed 29 Jan 2024
Hermans, E.J., et al.: Stress-related noradrenergic activity prompts large-scale neural network reconfiguration. Science 334(6059), 1151–1153 (2011). https://doi.org/10.1126/science.1209603. Accessed 29 Jan 2024
Shastri, D., Merla, A., Tsiamyrtzis, P., Pavlidis, I.: Imaging facial signs of neurophysiological responses. IEEE Trans. Biomed. Eng. 56(2), 477–484 (2009). https://doi.org/10.1109/TBME.2008.2003265. Accessed 30 Jan 2024
Dzedzickis, A., Kaklauskas, A., Bucinskas, V.: Human emotion recognition: review of sensors and methods. Sensors 20(3), 592 (2020). https://doi.org/10.3390/s20030592.Accessed 30 Jan 2024
Stemberger, J., Allison, R.S., Schnell, T.: Thermal imaging as a way to classify cognitive workload. In: 2010 Canadian Conference on Computer and Robot Vision, pp. 231–238 (2010). https://doi.org/10.1109/CRV.2010.37. https://ieeexplore.ieee.org/abstract/document/5479180. Accessed 30 Jan 2024
Hassoumi, A., Peysakhovich, V., Coz, A.L., Hurter, C., Causse, M.: Thermal imaging of the face: mental workload detection in flight simulator. In: Neuroergonomics and Cognitive Engineering, vol. 42. AHFE Open Access (2022). https://doi.org/10.54941/ahfe1001822. https://openaccess.cms-conferences.org/publications/book/978-1-958651-18-6/article/978-1-958651-18-610. ISSN: 27710718 Issue: 42. Accessed 30 Jan 2024
Pavlidis, I., Levine, J., Baukol, P.: Thermal imaging for anxiety detection. In: Proceedings IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications (Cat. No.PR00640), pp. 104–109 (2000). https://doi.org/10.1109/CVBVS.2000.855255. https://ieeexplore.ieee.org/abstract/document/855255. Accessed 30 Jan 2024
Levine, J.A., Pavlidis, I., Cooper, M.: The face of fear. Lancet 357(9270), 1757 (2001). https://doi.org/10.1016/S0140-6736(00)04936-9. Accessed 30 Jan 2024
Pavlidis, I., Levine, J.: Thermal image analysis for polygraph testing. IEEE Eng. Med. Biol. Maga. 21(6), 56–64 (2002). https://doi.org/10.1109/MEMB.2002.1175139. Accessed 30 Jan 2024
Gane, L., Power, S., Kushki, A., Chau, T.: Thermal imaging of the periorbital regions during the presentation of an auditory startle stimulus. PLoS ONE 6(11), 27268 (2011). https://doi.org/10.1371/journal.pone.0027268. Accessed 29 Jan 2024
Lohn, S. V.: Evaluating Physiological Responses during the Startle Response Using Thermal-Sensitive Goggles. PhD thesis, Northcentral University (2011). https://www.proquest.com/openview/d86955a543aaa96eb2442b226e6ec11f/1?cbl=18750&pq-origsite=gscholar&parentSessionId=6fyCvPL287RClxkYFjMPw2Z1FuCf2r2BO7tceabyXRw%3D. Accessed 30 Jan 2024
Hong, K., et al.: Detection and classification of stress using thermal imaging technique. In: Optics and Photonics for Counterterrorism and Crime Fighting, vol. 7486, pp. 140–148. SPIE (2009). https://doi.org/10.1117/12.830496. https://www.spiedigitallibrary.org/conferenceproceedings-of-spie/7486/74860I/Detection-and-classification-of-stress-usingthermal-imaging-technique/10.1117/12.830496.full. Accessed 30 Jan 2024
Durantin, G., Gagnon, J.-F., Tremblay, S., Dehais, F.: Using near infrared spectroscopy and heart rate variability to detect mental overload. Behav. Brain Res. 259, 16–23 (2014). https://doi.org/10.1016/j.bbr.2013.10.042. Accessed 30 Jan 2024
Causse, M., Chua, Z., Peysakhovich, V., Del Campo, N., Matton, N.: Mental workload and neural efficiency quantified in the prefrontal cortex using fNIRS. Sci. Rep. 7(1), 5222 (2017). https://doi.org/10.1038/s41598-017-05378-x. Accessed 30 Jan 2024
Causse, M., Chua, Z.K., Rémy, F.: Influences of age, mental workload, and flight experience on cognitive performance and prefrontal activity in private pilots: a fNIRS study. Sci. Rep. 9(1), 7688 (2019). https://doi.org/10.1038/s41598-019-44082-w. Accessed 30 Jan 2024
Cui, X., Bray, S., Bryant, D.M., Glover, G.H., Reiss, A.L.: A quantitative comparison of NIRS and fMRI across multiple cognitive tasks. Neuroimage 54(4), 2808–2821 (2011). https://doi.org/10.1016/j.neuroimage.2010.10.069. Accessed 2024-01-30
Santosa, H., Fishburn, F., Zhai, X., Huppert, T.J.: Investigation of the sensitivityspecificity of canonical- and deconvolution-based linear models in evoked functional near-infrared spectroscopy. Neurophotonics 6(2), 025009 (2019). https://doi.org/10.1117/1.NPh.6.2.025009. Accessed 30 Jan 2024
Klonsky, E.D., Victor, S.E., Hibbert, A.S., Hajcak, G.: The multidimensional emotion questionnaire (MEQ): rationale and initial psychometric properties. J. Psychopathol. Behav. Assess. 41(3), 409–424 (2019). https://doi.org/10.1007/s10862-019-09741-2. Accessed 31 Jan 2024
Courtois, R., et al.: Validation franc, aise du Big Five Inventory ‘a 10 items (BFI-10). L’Encéphale 46(6), 455–462 (2020) https://doi.org/10.1016/j.encep.2020.02.006. Accessed 31 Jan 2024
Spielberger, C.D.: State-trait anxiety inventory for adults. American Psychological Association (2012). https://doi.org/10.1037/t06496-000. http://doi.apa.org/getdoi.cfm?doi=10.1037/t06496-000. Accessed 31 Jan 2024
Cohen, S., Kamarck, T., Mermelstein, R.: A global measure of perceived stress. J. Health Soc. Behav. 24(4), 385–396 (1983) https://doi.org/10.2307/2136404. Accessed 31 Jan 2024
Mandrick, K., Peysakhovich, V., Rémy, F., Lepron, E., Causse, M.: Neural and psychophysiological correlates of human performance under stress and high mental workload. Biol. Psychol. 121, 62–73 (2016). https://doi.org/10.1016/j.biopsycho.2016.10.002. Accessed 31 Jan 2024
Causse, M., Peysakhovich, V., Mandrick, K.: Eliciting sustained mental effort using the toulouse N-back task: prefrontal cortex and pupillary responses. In: Hale, K.S., Stanney, K.M. (eds.) Advances in Neuroergonomics and Cognitive Engineering. Advances in Intelligent Systems and Computing, pp. 185–193. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-41691-5_16
Brainard, D.H.: The psychophysics toolbox. Spat. Vision 10(4), 433–436 (1997). https://doi.org/10.1163/156856897X00357. Accessed 30 Jan 2024
Pelli, D.G.: The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat. Vision 10(4), 437–442 (1997). https://doi.org/10.1163/156856897x00366. Accessed 30 Jan 2024
Kleiner, M., Brainard, D., Pelli, D., Ingling, A., Murray, R., Broussard, C.: What’s new in psychtoolbox-3. Perception 36(14), 1–16 (2007)
Kothe, C.: Labstreaminglayer. Swartz Center for Computational Neuroscience. originaldate: 2018-02-28T10:50:12Z (2013). https://github.com/sccn/labstreaminglayer Accessed 31 Jan 2024
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Deniel, J., Neubert, J., Schwartz, F., Causse, M. (2024). Impact of Startle Reflex on Cognitive Performance, Face Temperature and Brain Activity. In: Harris, D., Li, WC. (eds) Engineering Psychology and Cognitive Ergonomics. HCII 2024. Lecture Notes in Computer Science(), vol 14692. Springer, Cham. https://doi.org/10.1007/978-3-031-60728-8_4
Download citation
DOI: https://doi.org/10.1007/978-3-031-60728-8_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-60727-1
Online ISBN: 978-3-031-60728-8
eBook Packages: Computer ScienceComputer Science (R0)