Calculations Suggest It’ll Be Impossible to Control a Super-Intelligent AI

Contact Your Elected Officials
Science Alert Header

The idea of artificial intelligence overthrowing humankind has been talked about for many decades, and in January 2021, scientists delivered their verdict on whether we’d be able to control a high-level computer super-intelligence. The answer? Almost definitely not.

The catch is that controlling a super-intelligence far beyond human comprehension would require a simulation of that super-intelligence which we can analyze. But if we’re unable to comprehend it, it’s impossible to create such a simulation.

Rules such as ’cause no harm to humans’ can’t be set if we don’t understand the kind of scenarios that an AI is going to come up with, suggest the authors of the 2021 paper. Once a computer system is working on a level above the scope of our programmers, we can no longer set limits.

“A super-intelligence poses a fundamentally different problem than those typically studied under the banner of ‘robot ethics’,” wrote the researchers.

“This is because a superintelligence is multi-faceted, and therefore potentially capable of mobilizing a diversity of resources in order to achieve objectives that are potentially incomprehensible to humans, let alone controllable.”

Part of the team’s reasoning comes from the halting problem put forward by Alan Turing in 1936. The problem centers on knowing whether or not a computer program will reach a conclusion and answer (so it halts), or simply loop forever trying to find one.

As Turing proved through some smart math, while we can know that for some specific programs, it’s logically impossible to find a way that will allow us to know that for every potential program that could ever be written. That brings us back to AI, which in a super-intelligent state could feasibly hold every possible computer program in its memory at once.

Any program written to stop AI harming humans and destroying the world, for example, may reach a conclusion (and halt) or not โ€“ it’s mathematically impossible for us to be absolutely sure either way, which means it’s not containable.

“In effect, this makes the containment algorithm unusable,” said computer scientist Iyad Rahwan, from the Max-Planck Institute for Human Development in Germany back in January.

The alternative to teaching AI some ethics and telling it not to destroy the world โ€“ something which no algorithm can be absolutely certain of doing, the researchers say โ€“ is to limit the capabilities of the super-intelligence. It could be cut off from parts of the internet or from certain networks, for example.

The recent study rejects this idea too, suggesting that it would limit the reach of the artificial intelligence โ€“ the argument goes that if we’re not going to use it to solve problems beyond the scope of humans, then why create it at all?

If we are going to push ahead with artificial intelligence, we might not even know when a super-intelligence beyond our control arrives, such is its incomprehensibility. That means we need to start asking some serious questions about the directions we’re going in.

“A super-intelligent machine that controls the world sounds like science fiction,” said computer scientist Manuel Cebrian, from the Max-Planck Institute for Human Development. “But there are already machines that perform certain important tasks independently without programmers fully understanding how they learned it.”

“The question therefore arises whether this could at some point become uncontrollable and dangerous for humanity.”

The research was published in the Journal of Artificial Intelligence Research.

A version of this article was first published in January 2021.

By DAVID NIELD

Read Original Article on ScienceAlert.com

The Thinking Conservative
The Thinking Conservativehttps://www.thethinkingconservative.com/
The goal of THE THINKING CONSERVATIVE is to help us educate ourselves on conservative topics of importance to our freedom and our pursuit of happiness. We do this by sharing conservative opinions on all kinds of subjects, from all types of people, and all kinds of media, in a way that will challenge our perceptions and help us to make educated choices.

Remember Epsteinโ€™s โ€œLittle Black Booksโ€?

Image of Bill Clinton getting a massage from Jeffrey...

On the Major Leagueโ€™s periphery: A major trip through the minors

For Nick Dunn, the trek through the minors is a trifecta of physical, mental, and organizational hurdles filled with politics, roster volatility, and injuries.

Private Citizens are Now Looking into Epstein Client List

Most Americans have never felt so betrayed and confused by a president and his admin as they are by the Trump admin over the Epstein client list issue.

Peace In Ukraine Wonโ€™t End The Westโ€™s Hybrid War On Russia

The Westโ€™s Hybrid War on Russia to follow peace in Ukraine is inevitable due to neoconservatives and liberal-globalists in its decision-making ecosystem.

Epstein Case Closed?

The DOJ and FBI announced on Sunday evening of the July 4th holiday weekend that Jeffry Epstein had no client list and didnโ€™t kill himself in prison.

Federal Judge Blocks Trumpโ€™s Birthright Citizenship Order After Supreme Court Ruling

Judge barred Trump admin from enforcing EO limiting birthright citizenship, after Supreme Court restricted judges from issuing nationwide injunctions.

California Might Stop Making Necessary Debt Payments for 2 Years

California State Legislature met the budget submission deadline and it was signed by the governor, but they still need to cut $12 billion in spending.

MP Materials Secures Rare Earths Deal With DOD, Shares Surge 50 Percent

MP Materials Corp. announced a public-private partnership with the DOD to build out rare earth magnet supply chain and reduce dependency on China.

Ex-CIA Director Brennan Says DOJ Hasnโ€™t Contacted Him About an Investigation

Former CIA Dir Brennan said he hasn't been contacted by DOJ, FBI, or CIA following reports he and former FBI Dir. Comey are under investigation.

RFK Jr. Bans Illegal Immigrants From Government-Funded Programs

HHS Sec. Robert F. Kennedy Jr. is rescinding a 1998 interpretation of a law that allowed illegal immigrants to access certain government-funded programs.

Rubio Set to Visit Malaysia for ASEAN Meetings Amid Tariff Tensions

A delegation including U.S. Sec. of State Marco Rubio will travel to Kuala Lumpur, Malaysia, for series of high-profile meetings between July 11 and 12.

US Will Collect More Than $300 Billion in Tariff Revenues This Year, Treasury Secretary Says

U.S. is on track to potentially raise โ€œwell over $300 billionโ€ in tariff income by end of the year, Treasury Sec. Scott Bessent said during WH Cabinet meeting.

Senate Panel Advances Trumpโ€™s CDC Director Nominee

A Senate committee on July 9 voted to advance the nomination of Susan Monarez to lead the Centers for Disease Control and Prevention (CDC).
spot_img

Related Articles