The CATIE participates in the Co2Team European project (Cognitive Collaboration for Teaming) as a third party of Bordeaux INP. This project provides the opportunity of an expert partnership with the German artificial intelligence laboratory DFKI and the European Center for Advanced Inflight Recovery ECAIR.

During a flight, pilots must master complex situations, while facing increasing system complexity due to the amount and type of information available. Co2Team (Cognitive Collaboration for Teaming) pursues the idea that a system based on artificial intelligence can effectively support the pilot through the use of cognitive computing.

Cognitive computing makes it possible to design decision support systems that can acquire knowledge and learn by understanding natural language. Compared to traditional systems, it can reason and interact more naturally with human beings. It is also able to put the content of its proposal into context. It weights its answers according to the trust and evidence it has.

Cognitive Computing continues to evolve as it ingests new information, scenarios and responses. It reasoned in a way that resembled human thought, so that the conclusions are obvious, transparent and useful.

By taking human factors into account in the design, development and use of these intelligent systems, the natural capacities of human cognition, the power of human-machine symbiosis can be enhanced. Experts (Pilots) and the system (Cognitive Computing) collaborate by doing what they do best.

The general objective of Co2Team is to propose a roadmap for a technical and methodological transition to more autonomous air transport. This transition will be based on an innovative bidirectional communication paradigm and an optimized shared authority between the human and an agent (intelligent system). The methodological postulate is based on the concept of keeping “human in the loop“. In this way, it is possible to benefit from the most effective pilot skills, such as the application of decision making, to achieve flight objectives and guarantee a maximum level of flight safety and better acceptability.

CATIE’s role in the project :

CATIE is the leader in the study and analysis of human factors for the integration of artificial intelligence in an aircraft cockpit. The objective is to identify the key factors on the human side and on the AI side, leading to Man-AI collaboration in an operational situation. This project will also be an opportunity for CATIE to showcase its knowledge and work on the H2020 Future Sky Safety Performance Envelop project.

Partners :

Project duration : 01.01.2019 – 31.12.2021

Latest news:

February 3, 2021

2 new scientific publications are issued from the CO2Team project

• a human factor’s approach for multimodal collaboration with Cognitive Computing tocreate a Human Intelligent Machine Team  in IOP Conference Series
• Human Factors approaches and Models in LOC-I Accident Analysis and Prevention: Flight Crew Resource Management Techniques as a Risk Mitigation tool in 1st International Conference on Cognitve Aircraft Systems – ICCAS

September 2, 2020

Co2Team project participated in the 10th EASN virtual conference on September 2, 2020. The session “HiMT: A Human Factors approach for multimodal collaboration with Cognitive Computing to create a Human intelligent Machine Team” chaired by Dr. Jean-Francois Brouckaert and presented by Charles DORMOY.

You can find more about the conference at : https://lnkd.in/ep8Q-Du

Progress of the Co2Team project:

September 1, 2020

Co2Team is now working on WP4 defining case studies and demonstration in a flight simulator to validate the potential of a Cognitive Computing Teammate for the pilot in Single Pilot Operation. In the task 4.1 the Co2Team consortium identified a specific use case and a flight scenario has been designed with pilots and human factors experts. The scenario includes several flight phases (descent, approach, Go Around, and landing) the most accident prone according to Airbus and Boeing figures. The use case scenario has been submitted and discussed with the Advisory Board of the project i.e Airbus, Thales, Dassault. They found it interesting and in relation to their expectations. Based on the work and results of the previous WPs and in particular WP3, we are now selecting the best available technologies for the HMI² that will be developed and used for the use case and the A320 flight simulator.

June 30, 2020:

Co2Team’s partners have completed the 3^rd milestone of the project by submitting the two deliverables of Work Package 3.

First, a review of Cognitive technologies for bidirectional Human-System collaboration. The deliverable presents computer vision, speech recognition and some wearable devices as the core of a potential cognitive computing technology for single pilot operations and provides insights into hardware, software, and interaction paradigms. A cognitive computing teammate equipped with sensors needs access to data from airplane to be able to provide helpful insights to the pilot. An overview of data flow in the airplane and cockpit is provided with insights regarding interfacing with an intelligent teammate. A review of the added value of multimodality for bidirectional communication enabling more natural communication and better collaboration is provided, as well as a consideration of technologies used and their HMI² from a human factors and reliability perspective. The results of this deliverable will allow Co2Team to design experiments using some or all of the technologies and modalities mentioned.

Second, a Technology Forecast 2018-2035

With the rapid grow of artificial intelligence, there are often conflicting or incomplete definitions on what is meant by AI. Here it is clarified what is actually not meant by AI, but rather what properties make a certain technology part of AI. To understand the potential of each technology better, it is often useful to study its evolution in the past. With lessons from the past, insights about where the technologies will be by year 2035 is provided. The past evolution of augmented reality, speech recognition, robotics, interfaces, wearable devices, machine learning, and single pilot operations provides good insights on which future directions research and development will go. This deliverable provides insights on the future of technologies and why they are worth investing in the long-run.

This project has received funding from the Clean Sky 2 Joint Undertaking under the European Union’s Horizon 2020 research and innovation programme under grant agreement No 831891.

For more information on the Clean Sky 2 program: www.cleansky.eu

Latest news about Co2team : https://www.catie.fr/co2team-milestone-3-completed/