Nicholas Carr wrote a really interesting article on the dangers of computer automation. In All Can Be Lost: The Risk of Putting Our Knowledge in the Hands of Machines he weaves together stories about airline crashes and Inuit hunters to make salient points like this:
Psychologists have found that when we work with computers, we often fall victim to two cognitive ailments — complacency and bias — that can undercut our performance and lead to mistakes. Automation complacency occurs when a computer lulls us into a false sense of security. Confident that the machine will work flawlessly and handle any problem that crops up, we allow our attention to drift. We become disengaged from our work, and our awareness of what’s going on around us fades. Automation bias occurs when we place too much faith in the accuracy of the information coming through our monitors. Our trust in the software becomes so strong that we ignore or discount other information sources, including our own eyes and ears. When a computer provides incorrect or insufficient data, we remain oblivious to the error.
Carr goes to great lengths to make the argument that the automation of tasks is slowly robbing us of the ability to learn new skills. It is, in some ways, a more nuanced argument than his famous 2008 article Is Google Making Us Stupid? It’s well worth reading — even if you’re skeptical of this argument, it will definitely make you think.