With or without AI we already have issues with too much automation/assistance, and it get bad when automation they are failing/lack of maintaining.<p>Basically if you can drive a manual car, it is easy to drive an automatic one, but the opposite is not true.<p>Old GPS and even new one got 15% of the time the address wrong when I was a mover. Not only GPS failed, but what do you do when you have no usable maps?<p>Well, we have fired the people doing the maps, they are hardly updated at the pace mayors and real estates promoters are changing the territory, if you have an awesome GPS with no updated maps your GPS is useless, no?<p>We are forgetting to do the heavy underlying costly maintaining of maps, directions, forming drivers to read signs figuring GPS made them obsolete. Now we have to maintain: maps, satellite, computers and to live with people unable to use a map and a compass that are distracted when they drive by potentially wrong information and to dumb to read the sign saying there are entering a one way street in counter sense relying on their GPS.<p>Then too, the automation in Airbus/tesla and Boeing have proven to be less valuable then pilots' experience when computers fail due to false négative (frozen Pitot probes) or false positive (sun blinding cameras). I think civil and military records about accidents are a nice source of information about "right level of automation".<p>The problem is keeping up to date workers requires constant, heavy practice without too much automation. And human time nowadays is expensive.<p>That is one of the reason France (at the opposite of Japan) kept automation in nuclear plant rudimentary. Because when a system is critical, you really prefer human that can handle stuff at 99.999% than a computer that do great 100% of the time if and only if its sensors do works or nothing too catastrophic happens (flood, tsunamin, earthquake)<p>The problem is industry wants to spare on costly formations and educations (not the one from the university, I mean the one that is useful) but knowledge you have not yet crafted because of change of circumstances (I will be delighted to see how self driving car are behaving in massive congestion with dead locks) will be hard to program if we lose the common sense of doing the stuff by ourselves. How do you correct a machine misfunctioning to do something you have forgotten to do correctly yourself? You may even ignore when it will fail. Not because of it, but because of your lack of referential.