When AI is brought into a complex system we observe varying degrees of success. This rests on the complexity of the system, the training and understanding of the end user as well as the maintenance processes around the system. In examples of simple systems we have seem measured success in academic studies relating to gearboxes. However, when we move to add AI into more complex system we start to see serious problems appear.
For example, in the Boeing Air Max Disaster, AI had been added to a platform and taken away the users’ prerogative to move outside the extremely reserved `envelope’ of operation, leading to loss of life. To prevent such disasters, the implementation of AI in complex systems, especially related to aerospace and subsurface industries, needs to be considered carefully.
Sullenberger – The pilot of the Plane that downed in the Hudson River, states that the operators of complex systems such as aircraft are so highly attuned that they know the `feel’ of the vessel and every valve and connection in the system. Indeed Captain Sullenberger states that “pilots must be capable of absolute mastery of the aircraft and the situation at all times, a concept pilots call airmanship”. In the same way we could feel that something was wrong with our car when we had manual steering columns, an operator knows their system.
This can cause problems as we have seen on the Boeing Air Max Crashed where instead of purchasing new platforms, Boeing decided to mount large, more fuel efficient engines onto the existing air frame. This meant the engines had to be mounted higher and farther forward on the wings than for previous models of the 737. This significantly changed the aerodynamics of the aircraft and created the possibility of a nose-up stall under certain flight conditions. There were multiple explanations for the crashes but only one was a design flaw, this flaw was within the MAX’s new flight control software system designed to prevent stalls. The remaining explanations were ethical and political: internal pressure to keep pace with Boeing’s chief competitor, Airbus; Boeing’s lack of transparency about the new software; and the lack of adequate monitoring of Boeing by the Federal Aviation Authority (FAA) , especially during the certification of the MAX model and following the first crash.
Read the full article here.