Don’t fear AI, fear power-hungry humans

Don’t fear AI, fear power-hungry humans

Story by Big Think

We live in strange times, when the technology we depend on the most is also that which we fear the most. We celebrate cutting-edge achievements even as we recoil in fear at how they could be used to hurt us. From genetic engineering and AI to nuclear technology and nanobots, the list of awe-inspiring, fast-developing technologies is long.

However, this fear of the machine is not as new as it may seem. Technology has a longstanding alliance with power and the state. The dark side of human history can be told as a series of wars whose victors are often those with the most advanced technology. (There are exceptions, of course.) Science, and its technological offspring, follows the money.

This fear of the machine seems to be misplaced. The machine has no intent: only its maker does. The fear of the machine is, in essence, the fear we have of each other — of what we are capable of doing to one another.


How AI changes things

Sure, you would reply, but AI changes everything. With artificial intelligence, the machine itself will develop some sort of autonomy, however ill-defined. It will have a will of its own. And this will, if it reflects anything that seems human, will not be benevolent. With AI, the claim goes, the machine will somehow know what it must do to get rid of us. It will threaten us as a species.

Well, this fear is also not new. Mary Shelley wrote Frankenstein in 1818 to warn us of what science could do if it served the wrong calling. In the case of her novel, Dr. Frankenstein’s call was to win the battle against death — to reverse the course of nature. Granted, any cure of an illness interferes with the normal workings of nature, yet we are justly proud of having developed cures for our ailments, prolonging life and increasing its quality. Science can achieve nothing more noble. What messes things up is when the pursuit of good is confused with that of power. In this distorted scale, the more powerful the better. The ultimate goal is to be as powerful as gods — masters of time, of life and death.

Should countries create a World Mind Organization that controls the technologies that develop AI?

Back to AI, there is no doubt the technology will help us tremendously. We will have better medical diagnostics, better traffic control, better bridge designs, and better pedagogical animations to teach in the classroom and virtually. But we will also have better winnings in the stock market, better war strategies, and better soldiers and remote ways of killing. This grants real power to those who control the best technologies. It increases the take of the winners of wars — those fought with weapons, and those fought with money.

A story as old as civilization

The question is how to move forward. This is where things get interesting and complicated. We hear over and over again that there is an urgent need for safeguards, for controls and legislation to deal with the AI revolution. Great. But if these machines are essentially functioning in a semi-black box of self-teaching neural nets, how exactly are we going to make safeguards that are sure to remain effective? How are we to ensure that the AI, with its unlimited ability to gather data, will not come up with new ways to bypass our safeguards, the same way that people break into safes?

The second question is that of global control. As I wrote before, overseeing new technology is complex. Should countries create a World Mind Organization that controls the technologies that develop AI? If so, how do we organize this planet-wide governing board? Who should be a part of its governing structure? What mechanisms will ensure that governments and private companies do not secretly break the rules, especially when to do so would put the most advanced weapons in the hands of the rule breakers? They will need those, after all, if other actors break the rules as well.

As before, the countries with the best scientists and engineers will have a great advantage. A new international détente will emerge in the molds of the nuclear détente of the Cold War. Again, we will fear destructive technology falling into the wrong hands. This can happen easily. AI machines will not need to be built at an industrial scale, as nuclear capabilities were, and AI-based terrorism will be a force to reckon with.

So here we are, afraid of our own technology all over again.

What is missing from this picture? It continues to illustrate the same destructive pattern of greed and power that has defined so much of our civilization. The failure it shows is moral, and only we can change it. We define civilization by the accumulation of wealth, and this worldview is killing us. The project of civilization we invented has become self-cannibalizing. As long as we do not see this, and we keep on following the same route we have trodden for the past 10,000 years, it will be very hard to legislate the technology to come and to ensure such legislation is followed. Unless, of course, AI helps us become better humans, perhaps by teaching us how stupid we have been for so long. This sounds far-fetched, given who this AI will be serving. But one can always hope.

This article originally appeared on Big Think, home of the brightest minds and biggest ideas of all time.

Sign up for Big Think’s newsletter

Marcelo Gleiser
Marcelo Gleiser is a professor of natural philosophy, physics, and astronomy at Dartmouth College. He is a Fellow of the American Physical Society, a recipient of the Presidential Faculty Fellows Award from the White House and NSF, and was awarded the 2019 Templeton Prize. Gleiser has authored five books and is the co-founder of 13.8, where he writes about science and culture with physicist Adam Frank.
What will the $100 genome mean?

A company has slashed the cost of assessing a person's genome to just $100. With lower costs - and as other genetic tools mature and evolve - a wave of new therapies could be coming in the near future.

Adobe Stock

In May 2022, Californian biotech Ultima Genomics announced that its UG 100 platform was capable of sequencing an entire human genome for just $100, a landmark moment in the history of the field. The announcement was particularly remarkable because few had previously heard of the company, a relative unknown in an industry long dominated by global giant Illumina which controls about 80 percent of the world’s sequencing market.

Ultima’s secret was to completely revamp many technical aspects of the way Illumina have traditionally deciphered DNA. The process usually involves first splitting the double helix DNA structure into single strands, then breaking these strands into short fragments which are laid out on a glass surface called a flow cell. When this flow cell is loaded into the sequencing machine, color-coded tags are attached to each individual base letter. A laser scans the bases individually while a camera simultaneously records the color associated with them, a process which is repeated until every single fragment has been sequenced.

Instead, Ultima has found a series of shortcuts to slash the cost and boost efficiency. “Ultima Genomics has developed a fundamentally new sequencing architecture designed to scale beyond conventional approaches,” says Josh Lauer, Ultima’s chief commercial officer.

Keep Reading Keep Reading
David Cox
David Cox is a science and health writer based in the UK. He has a PhD in neuroscience from the University of Cambridge and has written for newspapers and broadcasters worldwide including BBC News, New York Times, and The Guardian. You can follow him on Twitter @DrDavidACox.
Farmers and ranchers share land for healthier food and less waste

Sharing land and other resources among farmers isn’t new. But research shows it may be increasingly relevant in a time of climatic upheaval.

Adobe Stock

The livestock trucks arrived all night. One after the other they backed up to the wood chute leading to a dusty corral and loosed their cargo — 580 head of cattle by the time the last truck pulled away at 3pm the next afternoon. Dan Probert, astride his horse, guided the cows to paddocks of pristine grassland stretching alongside the snow-peaked Wallowa Mountains. They’d spend the summer here grazing bunchgrass and clovers and biscuitroot. The scuffle of their hooves and nibbles of their teeth would mimic the elk, antelope and bison that are thought to have historically roamed this portion of northeastern Oregon’s Zumwalt Prairie, helping grasses grow and restoring health to the soil.

The cows weren’t Probert’s, although the fifth-generation rancher and one other member of the Carman Ranch Direct grass-fed beef collective also raise their own herds here for part of every year. But in spring, when the prairie is in bloom, Probert receives cattle from several other ranchers. As the grasses wither in October, the cows move on to graze fertile pastures throughout the Columbia Basin, which stretches across several Pacific Northwest states; some overwinter on a vegetable farm in central Washington, feeding on corn leaves and pea vines left behind after harvest.

Keep Reading Keep Reading
Lela Nargi
Lela Nargi is a Brooklyn, NY-based veteran freelance journalist covering food and agriculture system, social justice issues, science & the environment, and the places where those topics intersect for The New York Times, The Guardian, the Food and Environment Reporting Network (FERN), Eater, Modern Farmer, USA Today, and other outlets. Find her at lelanargi.com.