Towards an Operational Design Domain for Safe Human-AI Teaming in the Field of AI-Based Air Traffic Controller Operations
Published in 2024 IEEE/AIAA 43st Digital Avionics Systems Conference (DASC), 2024
Advances in Artificial Intelligence (AI) introduce both promising real-world applications in various fields such as aviation but also challenges in assuring safety. Regulators in aviation mandate, as with any other application, compliance of these AI-based systems with high safety standards. This especially holds for Human-AI Teaming. The European Union Aviation Safety Agency (EASA) outlined in their concept paper the definitions of cooperation and collaboration between humans and AI, as well as the differences in terms of authority and task allocation. Therein, the question of safety in situations of collaboration with shared goals, dynamic task allocation, and partial authority within the Human-AI team is paramount. As a safety concept, EASA requires the usage of Operational Design Domains (ODDs) from the automotive field.
In this work, the concept of ODDs is transferred to the Air Traffic Control (ATC) domain. An initial ODD is defined for an AI-based digital team partner that supports Air Traffic Controllers in their daily work even for safety-critical tasks such as conflict detection and resolution. Additionally, the required tools for successfully executing this task is demonstrated. Based on the ODD description, conflict scenarios are generated and tested in a simulation environment, showcasing situations inside and outside the ODD. Based on these results, the feasibility of using ODDs in ATC is discussed, outlining a potential step towards the safe application of Human-AI Teaming.
Recommended citation: Stefani, T., Jameel, M., Hunger, R., Gerdes, I., Anilkumar Girija, A., Christensen, J. M., Bruder, C., Köster, F., Hallerbach, S. and Krüger, T. "Towards Certifiable AI in Aviation: A Framework for Neural Network Assurance Using Advanced Visualization and Safety Nets", in 2024 IEEE/AIAA 43st Digital Avionics Systems Conference (DASC), Sep. 2024.
Download Paper