Thomas Levin of Princeton came to Bard Tuesday to give a lecture to the Drones Seminar, a weekly class I am participating in, led by my colleague Thomas Keenan and conceived by two of our students Arthur Holland and Dan Gettinger. Levin has studied surveillance techniques for years and he came to think with us about how the present obsession with drones will transform our landscape and our imaginations. At a time when the obsession with drones in the media is focused on their offensive capacities, it is important to recall that drones were originally developed as a surveillance technology. If drones are to become omnipresent in our lives, what will that mean?
Levin began by reminding us of the embrace of other surveillance devices in mass culture, like recording devices at the turn of the 20th century. He offered old postcards and cartoons in which unsuspecting servants or children were caught goofing off or insulting their superiors with newfangled recording devices like the cylinder phonograph and, later, hidden cameras and spy satellites. The realization emerges that we are being watched, and this sense pervades the popular consciousness. In looking to these representations from mass culture of the fear, awareness, and even expectation that we will be watched and listened to, Levin finds the emergence of what he calls “rhetoric of surveillance.”
In short, we talk and think constantly about the fact that we are or may be being watched. This cannot but change the way we behave and act. Levin poses this question. What, he asks, is the emerging drone imaginary?
To answer that question it is helpful to revisit an uncannily prescient imagination of the rise of drones in a text written over half a century ago, Ernst Jünger’s The Glass Bees. Originally published in 1957 and recently reissued in translation with an introduction by science fiction novelist Bruce Sterling, Jünger’s text centers around a job interview between an unnamed former light cavalry officer and Giacomo Zapparoni, secretive, filthy rich, and powerful proprietor of The Zapparoni Works that “manufactured robots for every imaginable purpose.” Zapparoni’s secret, however, is that he instead of big and hulking robots, he specialized in Lilliputian robots that gave “the impression of intelligent ants.”
The robots were not powerful in themselves, but they worked together. Like drone bees and drone ants—that exist only for procreation and then die—the small robots, or drones, serve specific purposes in industry or business. Zapparoni’s tiny robots “could count, weigh, sort gems or paper money….” Their power came from their coordination.
The robots “worked in dangerous locations, handling explosives, dangerous viruses, and even radioactive materials. Swarms of selectors could not only detect the faintest smell of smoke but could also extinguish a fire at an early stage; others repaired defective wiring, and still others fed upon filth and became indispensable in all jobs where cleanliness was essential.” Dispensable and efficient, Zapparoni’s little robots could do the most dangerous and least desirable tasks.
In The Glass Bees, we are introduced to Zapparoni’s latest invention: flying glass bees that can pollinate flowers much more efficiently and quickly than natural bees. The bees “were about the size of a walnut still encased in its green shell.” They were completely transparent and they were an improvement upon nature, at least insofar as the pollination of flowers was concerned. If a true or natural bee “sucked first on the calyx, at least a dessert remained.” But Zapparoni’s glass bees “proceeded more economically; that is, they drained the flower more thoroughly.” What is more, the bees were a marvel of agility and skill: “Given the flying speed, the fact that no collisions occurred during these flights back and forth was a masterly feat.” According to the cavalry officer, “It was evident that the natural procedure had been simplified, cut short, and standardized.”
Before our hero is introduced to Zapparoni’s bees, he is given a warning: “Beware of the bees!” And yet he forgets this warning. Watching the glass bees, the cavalry officer is fascinated. He felt himself “come under the spell of the deeper domain of techniques,” which like a spectacle “both enthralled and mesmerized.” His mind, he writes, went to sleep and he “forgot time” and “also entirely forgot the possibility of danger.”
Jünger’s book tells, in part, the story of our fascination and subjection to technologies of surveillance. On Facebook or Words with Friends, or even using our smart phones or GPS systems, we allow our fascination with technology to dull our sense of its danger. As Jünger writes: “Technical perfection strives toward the calculable, human perfection toward the incalculable. Perfect mechanisms—around which, therefore, stands an uncanny but fascinating halo of brilliance—evoke both fear and a titanic pride which will be humbled not by insight but only by catastrophe.”
The protagonist of The Glass Bees, a former member of the Light Cavalry and later a tank inspector, had once been fascinated by the “succession of ever new models becoming obsolete at an ever increasing speed, this cunning question-and-answer game between overbred brains.” What he came to see is that “the struggle for power had reached a new stage; it was fought with scientific formulas. The weapons vanished in the abyss like fleeting images, like pictures one throws into the fire. New ones were produced in protean succession.” Victory ceased to be about physical battle; it became, instead, a contest of technical mastery and knowledge.
The danger drones pose is not necessarily military. As General Stanley McChrystal rightly said when I asked him about this last week at the New York Historical Society, drones are simply another military tool that can be used for good or ill. Many fret today about collateral damage by drones and forget that if we had to send in armies to do these tasks the collateral damage would be much greater. Others worry about assassination, but drones are simply the tool, not the person pulling the trigger. It may be true that having drones when others don’t offers an enormous military advantage and makes the decision to go to kill easier, but when both sides have drones, we will all think heavily between beginning a cycle of illegal assassinations.
Rather, the danger of drones is how they change us as humans. As we humans interact more regularly with drones and machines and computers, we will inevitably come to expect ourselves and our friends and our colleagues and our lovers to act with the efficiency and selflessness of drones. Sherry Turkle worries that mechanical companions offer such fascination and unquestionable love that humans are beginning to prefer spending time with their machines than with other humans—who make demands, get tired, act cranky, and disappoint us. Ron Arkin has argued that robot soldiers will be more humane at war than human soldiers, who often act rashly out of exhaustion, anger, or revenge. Doctors are learning to rely on Watson and artificially intelligent medical machines, who can bring databases of knowledge to bear on diagnoses with the speed and objectivity that humans can only dream of. In every area of human life where humans once were thought to be necessary, drones and machines are proving more reliable, more capable, and more desirable.
The danger drones represent is not what they do better than humans, but that they do it better than humans. They are a further step in the human dream of self-improvement—the desire to overcome our shame at our all-too-human limitations.
The incredible popularity of drones today is partly a result of their freeing us to fight wars with ever-reduced human and economic costs. But drones are popular also because they appeal to the human desire for perfection. The question is, however, how perfect we humans can be before we begin to lose our humanity. That is, of course, the force of Jünger’s warning: Beware of the bees!
As drones appear everywhere around us, you would do well to put down the newspaper and turn off You Tube and, instead, revisit Ernst Jünger’s classic tale of drones. The Glass Bees is your weekend read. You can read Bruce Sterling’s introduction to The Glass Bees here.
One of the great documents of American history is the Constitution of the Commonwealth of Massachusetts, written in 1779 by John Adams.
In Section Two of Chapter Six, Adams offers one of the most eloquent testaments to the political virtues of education. He writes:
Wisdom and knowledge, as well as virtue, diffused generally among the body of the people, being necessary for the preservation of their rights and liberties; and as these depend on spreading the opportunities and advantages of education in the various parts of the country, and among the different orders of the people, it shall be the duty of legislatures and magistrates, in all future periods of this commonwealth, to cherish the interests of literature and the sciences, and all seminaries of them; especially the university at Cambridge, public schools, and grammar-schools in the towns; to encourage private societies and public institutions, rewards and immunities, for the promotion of agriculture, arts, sciences, commerce, trades, manufactures, and a natural history of the country; to countenance and inculcate the principles of humanity and general benevolence, public and private charity, industry and frugality, honesty and punctuality in their dealings; sincerity, and good humor, and all social affections and generous sentiments, among the people.
Adams felt deeply the connection between virtue and republican government. Like Montesquieu, whose writings are the foundation on which Adams’ constitutionalism is built, Adams knew that a democratic republic could only survive amidst people of virtue. That is why his Constitution also held that the “happiness of a people and the good order and preservation of civil government essentially depend upon piety, religion, and morality.”
For Adams, piety and morality depend upon religion. The Constitution he wrote thus holds that a democratic government must promote the “public worship of God and the public instructions in piety, religion, and morality.” One of the great questions of our time is whether a democratic community can promote and nourish the virtue necessary for civil government in an irreligious age? Is it possible, in other words, to maintain a citizenry oriented to the common sense and common good of the nation absent the religious bonds and beliefs that have traditionally taught awe and respect for those higher goods beyond the interests of individuals?
Hannah Arendt saw the ferocity of this question with clear eyes. Totalitarianism was, for here, the proof of the political victory of nihilism, the devaluation of the highest values, the proof that we now live in a world in which anything is possible and where human beings no longer could claim to be meaningfully different from ants or bees. Absent the religious grounding for human dignity, and in the wake of the loss of the Kantian faith of the dignity of human reason, what was left, Arendt asked, upon which to build the world of common meaning that would elevate human groups from their bestial impulses to the human pursuit of good and glory?
The question of civic education is paramount today, and especially for those of us charged with educating our youth. We need to ask, as Lee Schulman recently has: “What are the essential elements of moral and civic character for Americans? How can higher education contribute to developing these qualities in sustained and effective ways?” In short, we need to insist that our institutions aim to live up to the task Adams claimed for them: “to countenance and inculcate the principles of humanity and general benevolence, public and private charity, industry and frugality, honesty and punctuality in their dealings; sincerity, and good humor, and all social affections and generous sentiments, among the people.”
Everywhere we look, higher education is being dismissed as overly costly and irrelevant. In many, many cases, this is wrong and irresponsible. There is a reason that applications continue to increase at the best colleges around the country, and it is not simply because these colleges guarantee economic success. What distinguishes the elite educational institutions in the U.S. is not their ability to prepare students for technical careers. On the contrary, a liberal arts tradition offers useless education. But parents and students understand—explicitly or implicitly—that such useless education is powerfully useful. The great discoveries in physics come from useless basic research that then power satellites and computers. New brands emerge from late night reveries over the human psyche. And those who learn to conduct an orchestra or direct a play will years on have little difficulty managing a company. What students learn may be presently useless; but it builds the character and forms the intellect in ways that will have unintended and unimaginable consequences over lives and generations.
The theoretical justifications for the liberal arts are easy to mouth but difficult to put into practice. Especially today, defenses of higher education ignore the fact that colleges are not doing a great job of preparing students for democratic citizenship. Large lectures produce the mechanical digestion of information. Hyper-specialized seminars forget that our charge is to teach a liberal tradition. The fetishizing of research that no one reads exemplifies the rewarding of personal advancement at the expense of a common project. And, above all, the loss of any meaningful sense of a core curriculum reflects the abandonment of our responsibility to instruct students about making judgments about what is important. At faculties around the country, the desire to teach what one wants is seen as “liberal” and progressive, but it means in practice that students are advised that any knowledge is equally is good as any other knowledge.
To call for collective judgment about what students should learn is not to insist on a return to a Western canon. It is to say that if we as faculties cannot agree on what is important than we abdicate our responsibility as educators, to lead students into a common world as independent and engaged citizens who can, and will, then act to remake and re-imagine that world.
John Adams was one of Hannah Arendt’s favorite thinkers, and he was because he understood the deep connection between virtue and republicanism. Few documents are more worth revisiting today than the 1780 Constitution of the Commonwealth of Massachusetts. It is your weekend read.
The Wall Street Journal ran an interview this week with Luke Muehlhauser, the Executive Director of the Singularity Institute. The Journal asked: Will Artificial Intelligence Make us Obsolete? Muehlhauser's answer was, well yes. In his words:
Cognitive science has discovered that everything the human mind does is done by information processing and machines can do information processing too.
The first statement is clearly false, or at least depends on a strangely mixed up idea of "information processing." The old determinist canard that humans are simply complex machines has not been proven or discovered by cognitive science. And even if humans do process billions upon billions of bits of information it is not at all clear that such a humanly fallible process is reproducible. That is not the claim that cognitive science can make.
But cognitive science can claim that machines can be built that act in ways that are so like humans as to be almost nearly indistinguishable from them. Or, they can even be better than humans in doing many quintessentially human tasks. So machines can not only beat humans at chess, they can make moves that seem like moves only a human could have made, as Gary Kasparov learned to his dismay in the second game of his rematch with Deep Blue. Machines can create paintings that appear to be fully creative, as does Aaron, the painting machine created by artist and computer scientist Harold Cohen. And machines can increasingly make ethical decisions in warfare, as the robo-ethicist Ron Arkin has argued—decisions that are more humane than those made by human warriors.
Too much of the debate over artificial intelligence is caught up in the technical and really irrelevant question of whether machines can fully replicate human beings. The point is that if machines act "as if" they are human, or if they are capable of doing what humans do better than humans, we will gradually and continually allow machines to take over more and more of the basic human activities that make up our world. Already computers make most of the trades on Wall Street and computers are increasingly used in making medical diagnoses. Computers are being used to educate our children and write news stories. Caregivers for the elderly are being replaced by robotic companions. And David Levy, artificial intelligence researcher at the University of Maastricht in the Netherlands, argues that we will be marrying robots in the near future. It is not that these robotic lovers or artificial artists are human, but that they love and paint in ways that do or will soon pass the Turing test: they will be impossible to distinguish from human works.
Undoubtedly one reason machines are acting more human is that humans themselves are acting less so. As we interact more and more with machines, we begin to act predictably, repetitively, and less surprisingly. There is a convergence at foot, and it is the dehumanization of human beings as much as the humanization of robots that should be worrying us.
There is probably no presidential speech more quoted in Academic circles than Dwight D. Eisenhower's 1961 farewell speech, on the final day of his presidency. It was in that speech that Eisenhower warned of the danger of a military-industrial complex.
The need for a permanent army and a permanent arms industry creates, he writes, a gargantuan defense establishment that would wield an irresistible economic, political, and spiritual influence. In the face of this military-industrial complex, we as a nation must remain vigilant.
In the councils of government, we must guard against the acquisition of unwarranted influence, whether sought or unsought, by the military-industrial complex. The potential for the disastrous rise of misplaced power exists and will persist.
Eisenhower's speech was prescient. Particularly academics love to point to his speech to criticize bloated defense spending and point to the need to critically resist the military demands for more weapons and more soldiers. They are undoubtedly right to do so.
This is true even as today the military may be the one significant institution in American life where top leaders are arguing that America's world preeminence is not sustainable. In Edward Luce's excellent new book Time to Start Thinking, he describes how military leaders are convinced that the U.S. "should sharply reduced its "global footprint" by winding up all wars, notably in Afghanistan, and by closing peacetime military bases in Germany, South Korea, the UK, and elsewhere." The military leaders Luce spoke to also said that the US must learn to live with a nuclear Iran and "stop spending so much time and resources on the war against Al-Qaeda." Military leaders, Luce reports, are upset that "In this country 'shared sacrifice' means putting a yellow ribbon around the oak tree and then going shopping." Many military people seem to share Admiral Michael Mullen's view that the US national debt is the "country's number one threat—greater than that posed by terrorism, by weapons of mass destruction, and by global warming." One must think hard about the fact that military leaders see the need for "shared sacrifice" that will shrink the military-industrial complex while Americans and their elected leaders still speak about tax cuts and stimulus.
Too frequently forgotten in Eisenhower's speech, or even simply overlooked, is the fact that Eisenhower follows his discussion of the military-industrial complex with a similar warning about the dangers of a "revolution in the conduct of research." Parallel to the military-industrial complex is the danger of a university-government complex. (Hat Tip, Tom Billings (see comments)). Eisenhower writes:
Akin to, and largely responsible for the sweeping changes in our industrial-military posture, has been the technological revolution during recent decades. In this revolution, research has become central; it also becomes more formalized, complex, and costly. A steadily increasing share is conducted for, by, or at the direction of, the Federal government.
Today, the solitary inventor, tinkering in his shop, has been overshadowed by task forces of scientists in laboratories and testing fields. In the same fashion, the free university, historically the fountainhead of free ideas and scientific discovery, has experienced a revolution in the conduct of research. Partly because of the huge costs involved, a government contract becomes virtually a substitute for intellectual curiosity. For every old blackboard there are now hundreds of new electronic computers.
Just as modern warfare demands a huge and constant arms industry, so too does the technological revolution demand a huge and constant army of researchers and scientists. This army can only be organized and funded by government largesse. There is a danger, Eisenhower warns, that the university-government complex will take on a life of its own, manufacturing unreal needs (e.g. a Bachelor of Arts degree in order to manage an assembly line) and liberally funding research with little regards to quality, meaning, or need. While the university-government complex is not nearly as expensive or dangerous as the military-industrial complex, there is little doubt that it exists.
Eisenhower warns of a double threat of this university-government complex. First, the nation's scholars could be dominated by Federal employment, and gear their research to fit with governmental mandates. And second, the opposite danger, that "public policy could itself become the captive of a scientific-technological elite."
The existence and power of just such a scientific-technological elite is undeniable today. On the one side are the free-market idealogues, those acolytes of Friedman, Hayek, and Coase, who insist that policy be geared towards rational, self-regulating, economic actors. That real people do not conform to theories of rational behavior is a problem with the people, not the theories.
On the other side are the welfare-state adherents, who insist on governmental support for not only the poor, but also the working classes, the bankers, and corporations. The sad fact that 50 years of anti-poverty programs have not alleviated poverty or that record amounts of money spent on education has seen educational attainment decrease rather than increase is seen to be no argument for the failure of technocratic-governmental solutions. It just means more money and more technical know-how are needed.
It is simply amazing that people in academia can actually defend the current system that we are part of. Of course there are good schools and fine teachers and serious students. But we all know the system is a failure. Graduate students are without prospects; faculty spend so much time publishing articles and books that no one reads; administrators make ever more - sometimes twelve times as much as full professors-and come more and more to serve as the lifeblood of universities; and it is the rare student who amidst the large classes, absent faculty, and social and financial pressures, somehow makes college an intellectual experience.
The idea and practice of college needs to be re-imagined and re-thought. Entrenched interests will oppose this. But at this point the system is so broken that it simply cannot survive. On a financial level, large numbers of universities are being kept afloat on the largesse of federal student loans. If those loans were to disappear or dry up, many colleges would disappear or at the least shrink greatly. This should not happen. And yet, putting our young people $1 trillion in debt is not an answer. For too long we have been paying for our lifestyles with borrowed money. We are now used to our inflated lifestyles and unwilling to give them up. Something will have to give.
The current cost of a college education is unsustainable except for the very top schools that attract the very richest students who then fund endowments that allow those schools to subsidize economic, national, and racial diversity. For schools that cannot attract the wealthiest or do not have endowments that protect them from market forces, change will have to come. This will mean, in many instances, faculty salaries will decrease and costs will have to come down. In other colleges, costs will rise and university education will be ever less accessible. Either way, the conviction that everyone needs a liberal arts degree will probably be revised.
I have no crystal ball showing where this will all lead. But there are better and worse ways that the change will come, and I for one hope that if we turn to honestly thinking about it in the present, the future will be more palatable. This is the debate we need to have.
Rebecca Thomas has a long and thoughtful response to my post on Gary Kasparov's article on computers, chess, and humanity. The whole comment is worth reading. But here is how she begins:
Regarding the first of the three comments, I have to take issue with the idea that a chess game played by a computer is necessarily less beautiful than one played by a human. There are various kinds of beauty, and mathematical beauty is a very real thing. Some proofs are more elegant than others, for instance. Some x-y curves are quite beautiful, and often these are captured by particularly compact mathematical expressions. One could wonder why: is this preference for simplicity inherent in our idea of beauty, or have we preferentially developed (mathematical) language to describe things we find beautiful?
Surely, there is beauty to math. And there are various kinds of beauty. An efficient, powerful, and unstoppable game of chess played by a computer may be truly beautiful in its reduction of complexity to simplicity.
The point Kasparov makes is not that rationality is not beautiful in some way, but that it changes the idea of beauty in chess. A bold move, a risky move, a daring move has been valued in the world of chess. Chess, despite its rational reputation, has had an emotional and adventurous side. However, against computers--or even against humans aided by computers--such risks rarely succeed and thus they are devalued.
Chess changes. It becomes less quirky, less risky, and more rational. I don't think it wrong to say that chess becomes less human. Chess, in the age of computer chess, loses the valuation of a particularly human beauty, even if it might reflect an impeccably beautiful mathematical rationality.
It need not be that mathematical beauty is inferior to human beauty, as Rebecca suggests I must mean, but simply that the elimination of the human beauty as a meaningful option in chess is to be regretted.
II. Rebecca's second related point is to concede that chess players are internalizing the values of computer chess and thus playing more and more like computers. But, she argues this is not so new or so bad. Chess has changed before. New theories of chess emerge all the time. Why is this different? Why is this change, she might ask, the tipping point that makes chess less human?
I think the answer is the one given above. The values and approach to chess this particular change inaugurates take one element of chess--its rationality--and elevate it to the only relevant element of chess. All competing theories are judged by their ability to succeed over a hyper-rational strategy, and they will eventually be found wanting. Those who play chess (as opposed to making art with chess pieces) will succumb to the values of computerized chess. While earlier theories of chess may have aspired for complete dominance, only a purely rational computer chess can achieve that aim.