World Economic Forum lambasts AI bias

Ethical questions about artificial intelligence are being raised by “obvious problems” with biased algorithms

Surveillance, machine learning, facial recognition

A lack of diversity in the tech industry is raising serious questions about the future of artificial intelligence, according to the head of AI and machine learning at the World Economic Forum.

Speaking at an event in Tianjin, China, Kay Firth-Butterfield flagged the issue of bias within AI algorithms and called on the need to make the industry "much more diverse" in the West.

"There have been some obvious problems with AI algorithms," she told CNBC, mentioning a case that occurred in 2015, when Google's image-recognition software labelled a black man and his friend as gorillas'. According to a report published earlier this year by Wired, Google has yet to properly fix this issue - opting instead to simply block search terms for primates.

"As we've seen more and more of these things crop up, then the ethical debate around artificial intelligence has become much greater," said Firth-Butterfield. She also noted the rollout of General Data Protection Regulation (GDPR) in Europe, claiming this has brought ethical questions about data and technology "to the fore".

The dominance of "white men of a certain age" in building technology was signalled as a root cause for bias creeping into the algorithms behind AI. Training machine-learning systems on racially uneven data sets has previously been noted as a problem, particularly within facial-recognition software.

Advertisement
Advertisement - Article continues below

An experiment undertaken earlier this year at the Massachusetts Institute of Technology (MIT), for example, involved testing three commercially available face-recognition systems, developed by Microsoft, IBM and the Chinese firm Megvii. The results found that the systems correctly identified the gender of white men 99% of the time, but this success rate plummeted to 35% for black women.

Dr Adrian Weller, programme director for artificial intelligence at The Alan Turing Institute, told IT Pro: "Algorithmic systems are increasingly used in ways that can directly impact our lives, such as in making decisions about loans, hiring or even criminal sentencing. There is an urgent need to ensure that these systems treat all people fairly - they must not discriminate inappropriately against any individual or subgroup. 

"This is a particular concern when machine learning methods are used to train systems on past human decisions which may reflect historic prejudice."

Weller noted that a growing body of work is addressing the challenge of making algorithms fair, transparent and ethical. This outlook is similar to that of Firth-Butterfield, who emphasised that the World Economic Forum is trying to ensure AI grows "for the benefit of humanity".

Human diversity might not be the only issue facing AI bias. A recent study by Cardiff University and MIT found that groups of autonomous machines can demonstrate prejudice by simply identifying, copying and learning this behaviour from one another.

Featured Resources

The IT Pro guide to Windows 10 migration

Everything you need to know for a successful transition

Download now

Managing security risk and compliance in a challenging landscape

How key technology partners grow with your organisation

Download now

Software-defined storage for dummies

Control storage costs, eliminate storage bottlenecks and solve storage management challenges

Download now

6 best practices for escaping ransomware

A complete guide to tackling ransomware attacks

Download now
Advertisement

Recommended

Visit/technology/33253/toyota-partners-with-nvidia-to-create-the-future-of-autonomous-vehicles
Technology

Toyota, NVIDIA partner on self-driving cars

20 Mar 2019

Most Popular

Visit/cloud/microsoft-azure/354230/microsoft-not-amazon-is-going-to-win-the-cloud-wars
Microsoft Azure

Microsoft, not Amazon, is going to win the cloud wars

30 Nov 2019
Visit/cloud/amazon-web-services-aws/354223/what-to-expect-from-aws-reinvent-2019
Amazon Web Services (AWS)

What to expect from AWS Re:Invent 2019

29 Nov 2019
Visit/business/business-strategy/354252/huawei-takes-the-us-trade-sanctions-into-its-own-hands
Business strategy

Huawei takes the US trade sanctions into its own hands

3 Dec 2019
Visit/hardware/354237/five-signs-that-its-time-to-retire-it-kit
Sponsored

Five signs that it’s time to retire IT kit

29 Nov 2019