Gov launches investigation for potential bias in algorithms

Algorithms used in recruitment and the criminal justice system will be probed for fairness

The Centre for Data Ethics and Innovation (CDEI) will join forces with the Cabinet Office's Race Disparity Unit to investigate potential bias in algorithmic decision-making.

"Technology is a force for good and continues to improve people's lives but we must make sure it is developed in a safe and secure way," said Digital Secretary Jeremy Wright. "I'm pleased its team of experts is undertaking an investigation into the potential for bias in algorithmic decision-making in areas including crime, justice and financial services. I look forward to seeing the centre's future recommendations to help make sure we maximise the benefits of these powerful technologies for society."

As algorithms become more commonplace in today's society, their potential to help people increases. However, recent reports have shown that human bias can creep into algorithms, thus ultimately harming the people it's meant to help.

During job recruitment, algorithms can help evaluate candidates quickly, but some have been accused of gender bias. In Durham, the Harm Assessment Risk Tool used to assess defendant's risk of reoffending has been charged with being biased against the poor.

The CDEI will address bias in existing systems and support the production of fairer systems. Additionally, it will look for ways to increase innovation in the digital economy.

It will outline its priorities in its first work programme and strategy at a Downing Street event.

"We want to work with organisations so they can maximise the benefits of data driven technology and use it to ensure the decisions they make are fair," said Roger Taylor, chair of the Centre for Data Ethics and Innovation. "As a first step we will be exploring the potential for bias in key sectors where the decisions made by algorithms can have a big impact on people's lives."

The programme includes a plan on how to investigate micro-targeting and personalisation in online experiences. An example of this might be seeing ads for products similar to the ones you've just searched for.

The CDEI review will examine how, where and why these tactics are used and introduce nationwide workshops to determine the public's views on micro-targeting. Both reviews are set to publish final reports early next year with interim reports this summer.

The CDEI is a part of the government's wide-scale Industrial Strategy, which aims to stimulate job growth for business and "increase the earning power of people" through investment.

Featured Resources

Four cyber security essentials that your board of directors wants to know

The insights to help you deliver what they need

Download now

Data: A resource much too valuable to leave unprotected

Protect your data to protect your company

Download now

Improving cyber security for remote working

13 recommendations for security from any location

Download now

Why CEOS should care about the move to SAP S/4HANA

And how they can accelerate business value

Download now

Recommended

Workday's Accounting Center helps businesses manage financial data
chief financial officer (CFO)

Workday's Accounting Center helps businesses manage financial data

30 Oct 2020
MarqVision detects counterfeit products with deep learning and AI
intellectual property

MarqVision detects counterfeit products with deep learning and AI

18 Sep 2020
The IT Pro Podcast: Attack of the AI hackers
artificial intelligence (AI)

The IT Pro Podcast: Attack of the AI hackers

14 Aug 2020
MIT develops AI tech to edit outdated Wikipedia articles
artificial intelligence (AI)

MIT develops AI tech to edit outdated Wikipedia articles

13 Feb 2020

Most Popular

Cisco acquires container security startup Banzai Cloud
Security

Cisco acquires container security startup Banzai Cloud

18 Nov 2020
macOS Big Sur is bricking some older MacBooks
operating systems

macOS Big Sur is bricking some older MacBooks

16 Nov 2020
46 million Animal Jam accounts leaked after comms software breach
Security

46 million Animal Jam accounts leaked after comms software breach

13 Nov 2020