OpenAI refuses to make its AI writer open source over fake news fears

Although the technology can effortlessly write stories, researchers fear it could be used maliciously

AI

The accidental creation of an AI system capable of creating sophisticated fake news stories will be withheld from the open source community over fears it will be abused for malicious purposes.

Researchers at OpenAI institute said they were attempting to create an algorithm that could produce natural sounding text based upon extensive research and language processing, but soon realised it was capable of creating fake news stories taking cues from the 8 million web pages it trawled to learn about language.

Given how convincing some of these stories are, it's believed the system could be exploited to spread malicious or inflammatory content.

"We started testing it, and quickly discovered it's possible to generate malicious-esque content quite easily," said Jack Clark, policy director at OpenAI, speaking to the BBC.

Advertisement
Advertisement - Article continues below
Advertisement - Article continues below

OpenAI's researchers used content posted to link sharing site Reddit that had achieved a "karma" score of 3 or more to make the sources more reliable. It then uses these sources to write stories, making up attributions and quotes to make them sound more convincing.

However, researchers found that the occasionally included inaccuracies, with names and places being used incorrectly. The BBC references one story where a person named "Paddy Power" led a protest, for example.

The research will now be used as a platform to demonstrate that AI applications should be used carefully and to launch a debate about whether it should ever be used for things like news writing.

"It's not a matter of whether nefarious actors will utilise AI to create convincing fake news articles and deepfakes, they will," Brandie Nonnecke, director of Berkeley's CITRIS Policy Lab told the BBC.

"Platforms must recognise their role in mitigating its reach and impact. The era of platforms claiming immunity from liability over the distribution of content is over. Platforms must engage in evaluations of how their systems will be manipulated and build in transparent and accountable mechanisms for identifying and mitigating the spread of maliciously fake content."

Featured Resources

Digitally perfecting the supply chain

How new technologies are being leveraged to transform the manufacturing supply chain

Download now

Three keys to maximise application migration and modernisation success

Harness the benefits that modernised applications can offer

Download now

Your enterprise cloud solutions guide

Infrastructure designed to meet your company's IT needs for next-generation cloud applications

Download now

The 3 approaches of Breach and Attack Simulation technologies

A guide to the nuances of BAS, helping you stay one step ahead of cyber criminals

Download now
Advertisement

Most Popular

Visit/microsoft-windows/32066/what-to-do-if-youre-still-running-windows-7
Microsoft Windows

What to do if you're still running Windows 7

14 Jan 2020
Visit/operating-systems/25802/17-windows-10-problems-and-how-to-fix-them
operating systems

17 Windows 10 problems - and how to fix them

13 Jan 2020
Visit/operating-systems/microsoft-windows/354526/memes-and-viking-funerals-the-internet-reacts-to-the
Microsoft Windows

Memes and Viking funerals: The internet reacts to the death of Windows 7

14 Jan 2020
Visit/web-browser/30394/what-is-http-error-503-and-how-do-you-fix-it
web browser

What is HTTP error 503 and how do you fix it?

7 Jan 2020