Google's big red button should stop AI becoming too powerful

DeepMind develops 'way of stopping robots from ruling humanity'

Google researchers have developed a "big red button" in an attempt to stop any AI from becoming intelligent enough to rule over the human race.

London AI research lab DeepMind, acquired by Google in 2014, has joined forces with the University of Oxford in a bid to stop robots dominating humanity.

The findings were revealed in a paper called "Safely Interruptible Agents" and published on the Machine Intelligence Research Institute (MIRI)'s website, explaining AI agents are "unlikely to behave optimally all the time." 

"If such an agent is operating in real-time under human supervision, now and then it may be necessary for a human operator to press the big red button to prevent the agent from continuing a harmful sequence of actions harmful either for the agent or for the environment and lead the agent into a safer situation."

Advertisement - Article continues below

As a result of this research, the organisations have created a framework that means a human operator can safely interrupt AI, while simultaneously ensuring it won't backfire and the AI machine won't learn how humans can intercept.

It will do this by fooling the artificial intelligence agent into shutting down, leading it to believe it will get an award by doing so. However, only some algorithms can be safely intercepted, while others can't be, and this is the next stage of research DeepMind will investigate.

"Safe interruptibility can be useful to take control of a robot that is misbehaving and may lead to irreversible consequences, or to take it out of a delicate situation, or even to temporarily use it to achieve a task it did not learn to perform or would not normally receive rewards for this," the report explained.

However, the company didn't include information about when it expects the 'big red button' will need to be pushed.

Featured Resources

The essential guide to cloud-based backup and disaster recovery

Support business continuity by building a holistic emergency plan

Download now

Trends in modern data protection

A comprehensive view of the data protection landscape

Download now

How do vulnerabilities get into software?

90% of security incidents result from exploits against defects in software

Download now

Delivering the future of work - now

The CIO’s guide to building the unified digital workspace for today’s hybrid and multi-cloud strategies.

Download now

Most Popular

Microsoft Azure

Microsoft, not Amazon, is going to win the cloud wars

30 Nov 2019
Amazon Web Services (AWS)

What to expect from AWS Re:Invent 2019

29 Nov 2019

Raspberry Pi 4 owners complain of broken Wi-Fi when using HDMI

29 Nov 2019
Google Android

Samsung Galaxy A90 5G review: Simply the best value 5G phone

22 Nov 2019