Abstract
With recent advances in computer memory, speech analysis is becoming practical for real-time workload monitoring. Speech analysis can potentially provide a remote measure of physiological stress, without the need to attach sensors to the speaker, providing workload evidence that is not readily recognized by the human ear. It is especially appropriate for remote CRM applications, potentially providing a continued monitoring of individual physiological responses that can be accessed in real-time.
This paper reviews recent evidence for three basic speech measures of stress/workload: fundamental frequency, speaking rate, and amplitude. It summarizes results from a laboratory experiment and from three real-life accident situations: a helicopter accident, a 1994 accident involving the Boeing 737, and the 2014 disappearance of Malaysia flight 370.
M. Brenner—The author is a private consultant. He served for 26 years as a U.S. National Transportation Safety Board (NTSB) investigator and received the NTSB Chairman Award for technical excellence.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
. The study was funded by the U.S. Air Force. See: Brenner, M., Doherty, E. Thomas, and Shipp, T. (1994). Speech measures indicating workload demand. Aviation, Space, and Environmental Medicine, 65:21–6.
- 2.
Provided by the U.S. Federal Aviation Administration for scientific purposes.
- 3.
See: National Transportation Safety Board (1999). Aircraft Accident Report, NTSB/AAR-99/01, DCA-94-MA-076. Uncontrolled descent and collision with terrain, USAir Flight 427, Boeing 737–300, N513AU, near Aliquippa, Pennsylvania, September 8, 1994.
- 4.
NTSB (1999) DCA-94-MA-076 Crash of USAir Flight 427 Boeing 737 at Alequippa PA. Two figures prepared/shown at the public “sunshine” Board meeting, 1999: Overlay of CVR grunting sounds with reconstructed control inputs. Available on request from NTSB, Washington D.C.
- 5.
Safety Investigation Report, Malaysia Airlines Boeing B777-200ER (9M-MRO), 08 March 2014. By The Malaysian ICAO Annex 13 Safety Investigation Team for MH370, Issued on 02 July 2018, MH370/01/2018.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Brenner, M. (2024). Speech Analysis. In: Harris, D., Li, WC. (eds) Engineering Psychology and Cognitive Ergonomics. HCII 2024. Lecture Notes in Computer Science(), vol 14692. Springer, Cham. https://doi.org/10.1007/978-3-031-60728-8_1
Download citation
DOI: https://doi.org/10.1007/978-3-031-60728-8_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-60727-1
Online ISBN: 978-3-031-60728-8
eBook Packages: Computer ScienceComputer Science (R0)