Predicting Pilot Workloads Using Physiological Measures
DOI:
https://doi.org/10.37266/ISER.2025v12i1.pp1-6Keywords:
Pilot Sensing, Workload Recognition, Machine Learning, Physiological MeasuresAbstract
In this study, we utilized machine learning algorithms to predict pilot workload based on physiological, cognitive, and eye-tracking data collected from 7 pilots performing tasks in an unclassified F-35 flight simulator. We used the Bedford Workload Rating Scale (BWRS) to validate the high workload conditions induced during the simulated flight scenarios. We then trained models and compared their performance at predicting high workloads. Our results showed model performance was higher when classifiers were trained on individual pilots instead of on a group of pilots. We found that changes in Percent Change Pupil Size (PCPS), an eye-tracking measurement, were particularly noticeable in high vs. low-workload scenarios. This metric emerged as the most significant factor in distinctly difficult situations. These findings suggest a shift towards personalized machine-learning models for enhancing human-machine interactions in aviation through biometric and PCPS monitoring. Future work should examine a more diverse set of tasks, validated by study subjects, to assess the potential benefits of incorporating artificial intelligence (AI) assistance systems into the cockpit.
References
Brown, Jr., C. (2020, August). CSAF 22 Strategic Approach—Accelerate Change or Lose. U.S. Air Force.
Causse, M., Chua, Z., Peysakhovich, V., Del Campo, N., & Matton, N. (2017). Mental workload and neural efficiency quantified in the prefrontal cortex using fNIRS. Scientific Reports, 7(1), Article 1.
Causse, M., Sénard, J.-M., Démonet, J. F., & Pastor, J. (2010). Monitoring Cognitive and Emotional Processes Through Pupil and Cardiac Response During Dynamic Versus Logical Task. Applied Psychophysiology and Biofeedback, 35(2), 115–123.
Charles, R. L., & Nixon, J. (2019). Measuring mental workload using physiological measures: A systematic review. Applied Ergonomics, 74, 221–232.
Deputy Defense Secretary. (2016). Deputy Secretary: Third Offset Strategy Bolsters America’s Military Deterrence.
Dussault, C., Jouanin, J.-C., Philippe, M., & Guezennec, C.-Y. (2005). EEG and ECG changes during simulator operation reflect mental workload and vigilance. Aviation, Space, and Environmental Medicine, 76(4), 344–351.
Federal Aviation Administration. (2022, March 29). Glider Flying Handbook. Federal Aviation Administration.
Gateau, T., Ayaz, H., & Dehais, F. (2018). In silico vs. Over the Clouds: On-the-Fly Mental State Estimation of Aircraft Pilots, Using a Functional Near Infrared Spectroscopy Based Passive-BCI. Frontiers in Human Neuroscience, 12.
Harrison, J., Izzetoglu, K., Ayaz, H., Willems, B., Hah, S., Ahlstrom, U., Woo, H., Shewokis, P. A., Bunce, S. C., & Onaral, B. (2014). Cognitive Workload and Learning Assessment During the Implementation of a Next-Generation Air Traffic Control Technology Using Functional Near-Infrared Spectroscopy. IEEE Transactions on Human-Machine Systems, 44(4), 429–440.
Harrison, J., Izzetoglu, K., Ayaz, H., Willems, B., Hah, S., Woo, H., Shewokis, P. A., Bunce, S. C., & Onaral, B. (2013). Human Performance Assessment Study in Aviation Using Functional Near Infrared Spectroscopy. In D. D. Schmorrow & C. M. Fidopiastis (Eds.), Foundations of Augmented Cognition (Vol. 8027, pp. 433–442). Springer Berlin Heidelberg.
Hicks, J. S., Durbin, D. B., Morris, A. W., & Davis, B. M. (2014). A Summary of Crew Workload and Situational Awareness Ratings for U.S. Army Aviation Aircraft: Defense Technical Information Center.
Higginbotham, K., & Skaff, M. (2023, December). e-Pilot: Even Great Pilots Need a Cognitive Aid [White Paper]. Lockheed Martin Aeronautics.
Kakkos, I., Dimitrakopoulos, G. N., Gao, L., Zhang, Y., Qi, P., Matsopoulos, G. K., Thakor, N., Bezerianos, A., & Sun, Y. (2019). Mental Workload Drives Different Reorganizations of Functional Cortical Connectivity Between 2D and 3D Simulated Flight Experiments. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 27(9), 1704–1713.
Kramer, A. F. (1990). Physiological Metrics of Mental Workload: A Review of Recent Progress. Defense Technical Information Center.
Mathôt, S., & Ivanov, Y. (2019). The effect of pupil size and peripheral brightness on detection and discrimination performance. PeerJ, 7, e8220.
Matthews, G., Reinerman-Jones, L. E., Barber, D. J., & Abich, J. (2015). The Psychometrics of Mental Workload: Multiple Measures Are Sensitive but Divergent. Human Factors: The Journal of the Human Factors and Ergonomics Society, 57(1), 125–143.
Murata, A., & Iwase, H. (1998). Evaluation of Mental Workload by Fluctuation Analysis of Pupil Area. Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286), 6, 3094–3097.
National Commission on Military Aviation Safety. (2020, December 1). Report to the President and the Congress of the United States. National Commission on Military Aviation Safety.
Recarte, M. A., & Nunes, L. M. (2003). Mental workload while driving: Effects on visual search, discrimination, and decision making. Journal of Experimental Psychology: Applied, 9(2), 119–137.
Shaffer, F., & Ginsberg, J. P. (2017). An Overview of Heart Rate Variability Metrics and Norms. Frontiers in Public Health, 5, 258.
U.S. Air Force. (2019). U.S. Air Force 2030 Science and Technology Strategy.
van Weelden, E., Alimardani, M., Wiltshire, T. J., & Louwerse, M. M. (2022). Aviation and neurophysiology: A systematic review. Applied Ergonomics, 105, 103838.
Young, M. S., Brookhuis, K. A., Wickens, C. D., & Hancock, P. A. (2015). State of science: Mental workload in ergonomics. Ergonomics, 58(1), 1–17.
Published
How to Cite
Issue
Section
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
The copyediting stage is intended to improve the flow, clarity, grammar, wording, and formatting of the article. It represents the last chance for the author to make any substantial changes to the text because the next stage is restricted to typos and formatting corrections. The file to be copyedited is in Word or .rtf format and therefore can easily be edited as a word processing document. The set of instructions displayed here proposes two approaches to copyediting. One is based on Microsoft Word's Track Changes feature and requires that the copy editor, editor, and author have access to this program. A second system, which is software independent, has been borrowed, with permission, from the Harvard Educational Review. The journal editor is in a position to modify these instructions, so suggestions can be made to improve the process for this journal.
