The Evaluation Model of Pilot Visual Search with Onboard Context-Sensitive Information System | SpringerLink
Skip to main content

The Evaluation Model of Pilot Visual Search with Onboard Context-Sensitive Information System

  • Conference paper
  • First Online:
Engineering Psychology and Cognitive Ergonomics (HCII 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14017))

Included in the following conference series:

Abstract

This study is based on the attention allocation to investigate the evaluation model of pilot’s visual search performance. Based on the SEEV model of attention allocation, the evaluation model of pilot’s visual search performance was determined by three factors: expectancy, value and effort. The eye movement indicators such as fixation duration and numbers of fixation were selected to represent the influencing factors in the model, and the expert scoring method was used to determine the weight coefficient of each factor. Then, the comparative experiment was designed with the level of information systems (context-sensitive information system and electronic flight manuals) as the independent variable and visual search performance as the dependent variable. The eye-tracking data of 20 airline pilots were recorded in the simulator under each experimental scenario. Finally, the data was substituted into the model to verify its effectiveness and feasibility. The results showed that the pilot visual search performance evaluation model can effectively reflect the level of pilot’s visual search performance, and the level of pilot visual search performance in critical areas is effectively improved by using context-sensitive information system when handling malfunctions. The model can provide the theoretical reference for the training of standard operating procedures and the optimization of the context-sensitive information system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 10295
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 12869
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Xu, W.: User centered design (VII): from automated to intelligent Flight Deck. Chin. J. Appl. Psychol. 28(04), 291–313 (2022)

    Google Scholar 

  2. Human Factors-Harmonization Working Group: Flight Crew Error/Flight Crew Performance Considerations in the Flight Deck Certification Process. Human Factors-HWG Final Report (2004)

    Google Scholar 

  3. Liu, W., Yuan, X., Zhuang, D, et al.: Development of a simulated cockpit for synthetic ergonomic evaluation of pilot. China Saf. Sci. J. 13(11), 13–16 (2003)

    Google Scholar 

  4. Gerathewohl, S.: Leitfaden der militärischen Flugpsychologie. Verlag für Wehrwiss (1987)

    Google Scholar 

  5. Sun, R., Wang, N.: Visual features of pilot based on Markov chain under flight simulator. J. Beijing Univ. Aeronaut. Astronaut. 39(07), 897–901 (2013)

    Google Scholar 

  6. Wang, N., Yu, S., Xiao, L., et al.: Human-computer interface design considering visual attention. J. Xi’an Technol. Univ. 36(4), 334–339 (2016)

    Google Scholar 

  7. Ge, L., Xu, W.: User Experience: Theory and Practice. China Renmin University Press, Beijing (2020)

    Google Scholar 

  8. Liu, Z., Su, H., Lv, S., et al.: Measurement and comparison of situation awareness in air combat environment: evidence from eye movement. Chin. J. Ergon. 21(6), 17–21 (2015)

    Google Scholar 

  9. Li, W.C, Yu, C.S., Braithwaite, G., et al.: Pilots’ attention distributions between chasing a moving target and a stationary target. Aerosp. Med. Hum. Perform. 87(12), 989–995 (2016)

    Google Scholar 

  10. Wei, H.-Y., Zhuang, D.-M., Wanyan, X.-R., et al.: An experimental analysis of situation awareness for cockpit display interface evaluation based on flight simulation. Chin. J. Aeronaut. 26(4), 884–889 (2013)

    Google Scholar 

  11. Qu, S., Zhou, Q.: Effects of digital information display time on human and machines monitoring performance. Space Med. Med. Eng. 18(3), 191–195 (2005)

    Google Scholar 

  12. Goonetilleke, R.S., Lau, W.C., Shih, H.M.: Visual search strategies and eye movements when searching Chinese character screens. Int. J. Hum.-Comput. Stud. 57(6), 447–468 (2002)

    Google Scholar 

  13. Ojanp, H., Nasanen, R., Kojo, I.: Eye movements in the visual search of word lists. Vis. Res. 42(12), 1499–1512 (2002)

    Google Scholar 

  14. Christ, S.E., Abrams, R.A.: Abrupt onsets cannot be ignored. Psychon. Bull. Rev. 13(5), 875–880 (2006)

    Google Scholar 

  15. Chu, Y., Qin, H., Ran, L., et. al.: Influence of information layout of vehicle central control screen on visual search performance. Sci. Technol. Eng. 22(30), 13521–13526 (2022)

    Google Scholar 

  16. Chen, X., Huang, L., Li, M.: Visual search performance of intercity logistics APP interface navigation design. Packag. Eng. 42(08), 198–204 (2021)

    Google Scholar 

  17. Qu, Y., Zhu, S., Wang, W., et al.: Research on visual search cognitive characteristics of adaptive interface. Acta Electron. Sinica 49(02), 338–345 (2021)

    Google Scholar 

  18. Li, J., Yu, S., Wu, X.: Effects of shape character encodings in the human-computer interface on visual cognitive performance. J. Comput.-Aided Des. Comput. Graph. 30(01), 163–172+179 (2018)

    Google Scholar 

  19. Lin, C.C.: Effects of screen luminance combination and text color on visual performance with TFT-LCD. Int. J. Ind. Ergon. 35(3), 229–235 (2005)

    Article  Google Scholar 

  20. Bai, S., Huang, Y., Liu, J., et al.: An experimental study of improving visual search performance of pilot candidates by unconscious stimuli. Med. J. Air Force 32(04), 217–219+223 (2016)

    Google Scholar 

  21. Fan, X., Zhou, Q., Liu, Z., et al.: Principle of plane display interface design based on visual search. J. Beijing Univ. Aeronaut. Astronaut. 41(02), 216–221 (2015)

    Google Scholar 

  22. Svensson, E.A.I., Wilson, G.F.: Psychological and psychophysiological models of pilot performance for systems development and mission evaluation. Int. J. Aviat. Psychol. 12(1), 95–110 (2002)

    Article  Google Scholar 

  23. Wang, Y., Guo, X., Liu, Q., et al.: Eye movement characteristics research on pilots of different experience background during aircraft cockpit display image visual search task. In: Long, S., Dhillon, B.S. (eds.) Man–Machine–Environment System Engineering, pp. 85–94. Springer, Singapore (2018). https://doi.org/10.1007/978-981-10-6232-2_11

  24. Lazaro, M.J., Kang, Y., Yun, M.H., et al.: The effects of visual complexity and decluttering methods on visual search and target detection in cockpit displays. Int. J. Hum–Comput. Interact. 37(7), 588–600 (2021)

    Google Scholar 

  25. Ren, Y.T., Han, Y.C., Sui, X.: The saccades and its mechanism in the process of visual search. Adv. Psychol. Sci. 14(3), 340–345 (2006)

    Google Scholar 

  26. Wickens, C., McCarley, J., Thomas, L.: Attention-Situation Awareness (A-SA)Model. University of Illinois at Urbana Champaign, Illinois (2003)

    Google Scholar 

  27. Zhang, G., Shen, M., Tao, R.: The application of eye tracking in usability tests. J. Ergon. 7(4), 9–13 (2001)

    Google Scholar 

  28. Chen, J., Zhang, S., Zhou, Y., et al.: Availability evaluation of medical device instructions based on eye movement technique. China Health Ind. (5), 35–41 (2016)

    Google Scholar 

  29. Liu, Z., Yuan, X., Liu, W., et al.: Quantitative measuring method of pilots’ attention allocation. J. Beijing Univ. Aeronaut. Astronaut. 32(5), 518–520 (2006)

    Google Scholar 

  30. Zhang, X.: Modeling and simulation of Pilot's dynamic visual and motion performance in flight deck. Northwestern Polytechnical University (2016)

    Google Scholar 

  31. Kotval, X.P., Goldberg, J.H.: Eye movements and interface components grouping: an evaluation method. In: Proceedings of the Human Factors Society 42nd Annual Meeting, pp. 486–490 (1998)

    Google Scholar 

  32. Yuan, W.: Study on Car Driver's Dynamic Visual Characters Test on City Road. Chang’an University (2008)

    Google Scholar 

  33. Hornof, A.J., Halverson, T.: Cognitive strategies and eye movements for searching hierarchical computer displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 249–256 (2003)

    Google Scholar 

  34. Liu, Z., Yuan, X., Liu, W., et al.: Analysis on eye movement indices based on simulated flight task. China Saf. Sci. J. (02), 47–51+145 (2006)

    Google Scholar 

  35. Chen, X.: Research on Visual Search Performance Logistics APP Interface Navigation of Intercity Design. Jiangsu University (2020)

    Google Scholar 

Download references

Acknowledgments

The authors would like to appreciate the support of the Tianjin Graduate Science and Innovation Research Project (grant no. 2022SKY160). Thanks to Dr. Wang Lei for his supervision and guidance in this research. Thanks to Dr. Feiyin Wang, and Dr. Rong Zhang, who provided us with feedback, suggestions, and comments on this research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wenqing Wang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tan, W., Wang, W., Sun, Y. (2023). The Evaluation Model of Pilot Visual Search with Onboard Context-Sensitive Information System. In: Harris, D., Li, WC. (eds) Engineering Psychology and Cognitive Ergonomics. HCII 2023. Lecture Notes in Computer Science(), vol 14017. Springer, Cham. https://doi.org/10.1007/978-3-031-35392-5_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-35392-5_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-35391-8

  • Online ISBN: 978-3-031-35392-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics