Saturday, July 13, 2024

"The Gods of Logic: Before and after artificial intelligence"

From Harper's Magazine, July 2024 edition:

We will never know how many died during the Butlerian Jihad. Was it millions? Billions? Trillions, perhaps? It was a fantastic rage, a great revolt that spread like wildfire, consuming everything in its path, a chaos that engulfed generations in an orgy of destruction lasting almost a hundred years. A war with a death toll so high that it left a permanent scar on humanity’s soul. But we will never know the names of those who fought and died in it, or the immense suffering and destruction it caused, because the Butlerian Jihad, abominable and devastating as it was, never happened.

The Jihad was an imagined event, conjured up by Frank Herbert as part of the lore that animates his science-fiction saga Dune. It was humanity’s last stand against sentient technology, a crusade to overthrow the god of machine-logic and eradicate the conscious computers and robots that in the future had almost entirely enslaved us. Herbert described it as “a thalamic pause for all humankind,” an era of such violence run amok that it completely transformed the way society developed from then onward. But we know very little of what actually happened during the struggle itself, because in the original Dune series, Herbert gives us only the faintest outlines—hints, murmurs, and whispers, which carry the ghostly weight of prophecy. The Jihad reshaped civilization by outlawing artificial intelligence or any machine that simulated our minds, placing a damper on the worst excesses of technology. However, it was fought so many eons before the events portrayed in the novels that by the time they occur it has faded into legend and crystallized in apocrypha. The hard-won lessons of the catastrophe are preserved in popular wisdom and sayings: “Man may not be replaced.” “Once men turned their thinking over to machines in the hope that this would set them free. But that only permitted other men with machines to enslave them.” “We do not trust the unknown which can arise from imaginative technology.” “We must negate the machines-that-think.” The most enduring legacy of the Jihad was a profound change in humankind’s relationship to technology. Because the target of that great hunt, where we stalked and preyed upon the very artifacts we had created to lift ourselves above the seat that nature had intended for us, was not just mechanical intelligence but the machinelike attitude that had taken hold of our species: “Humans had set those machines to usurp our sense of beauty, our necessary selfdom out of which we make living judgments,” Herbert wrote.

Humans must set their own guidelines. This is not something machines can do. Reasoning depends upon programming, not on hardware, and we are the ultimate program!

The Butlerian Jihad removed a crutch—the part of ourselves that we had given over to technology—and forced human minds to develop above and beyond the limits of mechanistic reasoning, so that we would no longer depend on computers to do our thinking for us.

Herbert’s fantasy, his far-flung vision of a devastating war between humanity and the god of machine-logic, seemed quaint when he began writing it in the Sixties. Back then, computers were primitive by modern standards, massive mainframe contraptions that could process only hundreds of thousands of cycles per second (instead of billions, like today), had very little memory, operated via punch cards, and were not connected to one another. And we have easily ignored Herbert’s warnings ever since, but now the Butlerian Jihad has suddenly returned to plague us. The artificial-intelligence apocalypse is a new fear that keeps many up at night, a terror born of great advances that seem to suggest that, if we are not very careful, we may—with our own hands—bring forth a future where humanity has no place. This strange nightmare is a credible danger only because so many of our dreams are threatening to come true. It is the culmination of a long process that hearkens back to the origins of civilization itself, to the time when the world was filled with magic and dread, and the only way to guarantee our survival was to call down the power of the gods.

Apotheosis has always haunted the soul of humankind. Since ancient times we have suffered the longing to become gods and exceed the limits nature has placed on us. To achieve this, we built altars and performed rituals to ask for wisdom, blessings, and the means to reach beyond our capabilities. While we tend to believe that it is only now, in the modern world, that power and knowledge carry great risks, primitive knowledge was also dangerous, because in antiquity a part of our understanding of the world and ourselves did not come from us, but from the Other. From the gods, from spirits, from raging voices that spoke in silence.

At the heart of the mysteries of the Vedas, revealed by the people of India, lies the Altar of Fire: a sacrificial construct made from bricks laid down in precise mathematical proportions to form the shape of a huge bird of prey—an eagle, or a hawk, perhaps. According to Roberto Calasso, it was a gift from the primordial deity at the origin of everything: Prajapati, Lord of Creatures. When his children, the gods, complained that they could not escape from Death, he gave them precise instructions for how to build an altar that would permit them to ascend to heaven and attain immortality: “Take three hundred and sixty border stones and ten thousand, eight hundred bricks, as many as there are hours in a year,” he said. “Each brick shall have a name. Place them in five layers. Add more bricks to a total of eleven thousand, five hundred and fifty-six.” The gods built the altar and fled from Mrtyu, Death itself. However, Death prevented human beings from doing the same. We were not allowed to become immortal with our bodies; we could only aspire to everlasting works. The Vedic people continued to erect the Altar of Fire for thousands of years: with time, according to Calasso, they realized that every brick was a thought, that thoughts piled on top of each other created a wall—the mind, the power of attention—and that that mind, when properly developed, could fly like a bird with outstretched wings and conquer the skies.

Seen from afar by people who were not aware of what was being made, these men and women must surely have looked like bricklayers gone mad. And that same frantic folly seems to possess those who, in recent decades, have dedicated their hearts and minds to the building of a new mathematical construct, a soulless copy of certain aspects of our thinking that we have chosen to name “artificial intelligence,” a tool so formidable that, if we are to believe the most zealous among its devotees, will help us reach the heavens and become immortal.

Raw and abstract power, AI lacks body, consciousness, or desire, and so, some might say, it is incapable of generating that primordial heat that the Vedas call tapas—the ardor of the mind, the fervor from which all existence emerges—and that still burns, however faintly, within each and every one of us. Should we trust the most optimistic voices coming from Silicon Valley, AI could be the vehicle we use to create boundless wealth, cure all ills, heal the planet, and move toward immortality, while the pessimists warn that it may be our downfall. Has our time come to join the gods eternal? Or will our digital offspring usurp the Altar of Fire and use it for their own ends, as we ourselves stole that knowledge, originally intended for the gods? It’s far too early to tell. But we can be certain of one thing, since we have learned it, time and time again, from the punishing tales of our mythologies: it is never safe to call on the gods, or even come close to them.

In the mid-nineteenth century, the mathematician George Boole heard the voice of God. As he crossed a field near his home in England, he had a mystical experience and came to believe he would uncover the rules underlying human thought. The poor son of a cobbler, Boole was a child prodigy who taught himself calculus and worked as a schoolteacher in Doncaster until one of his papers earned him a gold medal from the Royal Society, and he secured an offer to become the first professor of mathematics at Queen’s College, Cork, in Ireland. Under the auspices of a university, and relatively free from the economic hardships that he had endured for so long, he could dedicate himself almost entirely to his passions for the first time, and he soon managed something unique: he married mathematics and logic in a system that would change the world....

....MUCH MORE