Tay scandal taught us to take accountability, says Microsoft CEO

Satya Nadella says Redmond has learned from its disastrous racist chatbot

Microsoft CEO Satya Nadella stressed today that it is the job of AI companies to ensure that artificial intelligence in kept under control.

Speaking at the London launch of his new book, Hit Refresh, IT Pro heard Nadella address the question posed by many AI sceptics regarding what happens if tech companies create an AI that gets out of hand.

"It's up to us. In other words, how do we approach this with a set of design principles that allow us to control what AI we create? Just like good user experience, I would claim there is good AI," he said. "As designers of AI, it's our responsibility."

Microsoft has invested heavily in the space and Nadella considers it to be one of the three main pillars of the company's future, along with quantum computing and mixed reality. It has made progress with AI most notably through its digital assistant Cortana, but in other areas as well, including machine vision and advanced analytics.

Advertisement - Article continues below
Advertisement - Article continues below

Some of its AI experiments, however, have been less successful. One particularly embarrassing failure was Tay, a Twitter-based chatbot powered by machine learning. Designed to emulate a teenage girl, Tay's conversation was supposed to become more natural through learning from social interactions with real users.

This quickly went off the rails, as trolls exploited the system in order to teach Tay to parrot racial slurs, conspiracy theories and other objectionable comments.

Nadella acknowledged that the experiment proved problematic, but said that the company has learnt from the incident.

"One of the things that has really influenced our design principles is that episode; we have to take accountability. First and foremost, we need to be able to in fact foresee these attacks," he said.

"But the idea that we need to keep the broader goal of having this AI behave properly is our accountability. So how can we test it, how can we make sure that it does not lose control is a lot of places where we're working now."

Featured Resources

How inkjet can transform your business

Get more out of your business by investing in the right printing technology

Download now

Journey to a modern workplace with Office 365: which tools and when?

A guide to how Office 365 builds a modern workplace

Download now

Modernise and transform your sales organisation

Learn how a modernised sales process can drive your business

Download now

Your guide to managing cloud transformation risk

Realise the benefits. Mitigate the risks

Download now


artificial intelligence (AI)

MIT develops AI tech to edit outdated Wikipedia articles

13 Feb 2020
cloud computing

Microsoft has an edge on AWS, according to IT executives

8 Jan 2020

The IT Pro Products of the Year 2019: All the year’s best hardware

24 Dec 2019

Microsoft Surface Laptop 3 13in review: Almost the perfect laptop

6 Dec 2019

Most Popular


How to use Chromecast without Wi-Fi

5 Feb 2020
Microsoft Windows

Microsoft pulls disastrous Windows 10 security update

17 Feb 2020
operating systems

How to fix a stuck Windows 10 update

12 Feb 2020
cloud computing

Google Cloud snaps up multi-cloud analytics platform for $2.6bn

13 Feb 2020