An Analytic Framework for Assessing Artificial Intelligence and Assistive Automation Enabled Command and Control Decision Aids for Mission Effectiveness


  • Thomas Mitchell
  • Noah Sheffield
  • Darius Richardson
  • Benjamin Jensen
  • Emily Nack
  • Iain Cruickshank
  • Robert Thomson
  • Nathaniel Bastian



Assessment Framework, Analytic Hierarchy Process, Combat Simulation, Artificial Intelligence, Decision Aids


The U.S. Army has significant interest in operationalizing Artificial Intelligence and Assistive Automation (AI/AA) technologies on the battlefield to help collate, classify, and clarify multiple streams of situational and sensor data to provide a Commander with a clear, accurate operating picture to enable rapid and appropriate decision-making. This paper offers a methodology integrated with combat simulation output data into an analytic assessment framework. This framework helps assess AI/AA enabled Decision Aids for command and control with respect to mission effectiveness. Our methodology is demonstrated via a real-world operational vignette of an AI/AA-augmented Battalion assigned to clearing a sector of the battlefield. Results indicate that the simulated scenario with an AI/AA advantage modeled led to a higher expected mission effectiveness score.


Adams, K. (2001). Future warfare and the decline of human decision making parameters (Vol. 31).

Aliotta, J. (2022). Army, west point hit milestone with robotics project. U.S. Army. Retrieved from article/254202/army_west_point_hit_milestone_with_robotics_project

Center, D. T. I. (2013). Afsim: The air force research laboratory’s approach to making M&S ubiquitous in the weapon system concept development process. CSIAC Journal, 1(4). doi: 10.21474/CSIAJ.2013.01.04.05

Cobb, A., Jalaian, B., Bastian, N., & Russell, S. (2021). Robust decision-making in the internet of battlefield things using bayesian neural networks. IEEE.

Hordyk, A. R., & Carruthers, T. R. (2018). A quantitative evaluation of a qualitative risk assessment framework: Examining the assumptions and predictions of the Productivity Susceptibility Analysis (PSA). PloS one, 13(6).

King, R., Churchill, E. F., & Tan, C. (2017). Designing with data: Improving the user experience with a/b testing. O’Reilly Media, Inc.

Letham, B., & Bakshy, E. (2019). Bayesian optimization for policy search via online offline experimentation. J. Mach. Learn. Res., 20, 145–1.

McGuinness, B., & Ebbage, L. (2002). Assessing human factors in command and control: Workload and situational awareness metrics. Defense Technical Information Center.

McKeon, A. (2022). Can artificial intelligence apply gaming to military strategy? northrop grumman. Retrieved from -military-strategy/

Pascoe, S., Bustamante, R., Wilcox, C., & Gibbs, M. (2009). Spatial fisheries management: a framework for multi-objective qualitative assessment. In (Vol. 52, pp. 130–138).

PEOSTRI. (2023). One semi-automated forces. Retrieved from

Saaty, R. (1987). The analytic hierarchy process—what it is and how it is used. Mathematical Modelling, 9(3–5), 161–176. doi: 10.1016/0270-0255(87)90473-8

Shaneman, S., George, J., & Busart, C. (2022). Scaling distributed artificial intelligence/machine learning for decision domi- nance in all-domain operations. In Artificial intelligence and machine learning for multi-domain operations applications (Vol. IV (Vol. 12113, p. 19–32). SPIE.

Srivastava, A., & Thomson, S. (2009). Framework analysis: a qualitative methodology for applied policy research.

TechTarget. (2017). Modeling and simulation (m&s). Retrieved from definition/modeling-and-simulation-MS

USMA. (2023). Combat simulation lab. Retrieved from

Violante, M. G., & Vezzetti, E. (2017). Kano qualitative vs quantitative approaches: An assessment framework for products attributes analysis. Computers in industry, 86, 15–25.

West, T., & Birkmire, B. (2020). Afsim: The air force research laboratory’s approach to making m&s ubiquitous in the weapon system concept development process – csiac. Retrieved from afsim-the-air-force-research-laboratorys-approach-to-making-ms-ubiquitous-in-the-weapon-system-concept-development-process/.



How to Cite

Mitchell, T., Sheffield, N., Richardson, D., Jensen, B., Nack, E., Cruickshank, I., Thomson, R., & Bastian, N. (2023). An Analytic Framework for Assessing Artificial Intelligence and Assistive Automation Enabled Command and Control Decision Aids for Mission Effectiveness. Industrial and Systems Engineering Review, 11(1-2), 1-8.