Gov launches investigation for potential bias in algorithms

Algorithms used in recruitment and the criminal justice system will be probed for fairness

algorithm in Python code

The Centre for Data Ethics and Innovation (CDEI) will join forces with the Cabinet Office's Race Disparity Unit to investigate potential bias in algorithmic decision-making.

"Technology is a force for good and continues to improve people's lives but we must make sure it is developed in a safe and secure way," said Digital Secretary Jeremy Wright. "I'm pleased its team of experts is undertaking an investigation into the potential for bias in algorithmic decision-making in areas including crime, justice and financial services. I look forward to seeing the centre's future recommendations to help make sure we maximise the benefits of these powerful technologies for society."

As algorithms become more commonplace in today's society, their potential to help people increases. However, recent reports have shown that human bias can creep into algorithms, thus ultimately harming the people it's meant to help.

During job recruitment, algorithms can help evaluate candidates quickly, but some have been accused of gender bias. In Durham, the Harm Assessment Risk Tool used to assess defendant's risk of reoffending has been charged with being biased against the poor.

Advertisement
Advertisement - Article continues below

The CDEI will address bias in existing systems and support the production of fairer systems. Additionally, it will look for ways to increase innovation in the digital economy.

It will outline its priorities in its first work programme and strategy at a Downing Street event.

"We want to work with organisations so they can maximise the benefits of data driven technology and use it to ensure the decisions they make are fair," said Roger Taylor, chair of the Centre for Data Ethics and Innovation. "As a first step we will be exploring the potential for bias in key sectors where the decisions made by algorithms can have a big impact on people's lives."

The programme includes a plan on how to investigate micro-targeting and personalisation in online experiences. An example of this might be seeing ads for products similar to the ones you've just searched for.

The CDEI review will examine how, where and why these tactics are used and introduce nationwide workshops to determine the public's views on micro-targeting. Both reviews are set to publish final reports early next year with interim reports this summer.

The CDEI is a part of the government's wide-scale Industrial Strategy, which aims to stimulate job growth for business and "increase the earning power of people" through investment.

Featured Resources

The IT Pro guide to Windows 10 migration

Everything you need to know for a successful transition

Download now

Managing security risk and compliance in a challenging landscape

How key technology partners grow with your organisation

Download now

Software-defined storage for dummies

Control storage costs, eliminate storage bottlenecks and solve storage management challenges

Download now

6 best practices for escaping ransomware

A complete guide to tackling ransomware attacks

Download now
Advertisement

Recommended

Visit/technology/33253/toyota-partners-with-nvidia-to-create-the-future-of-autonomous-vehicles
Technology

Toyota, NVIDIA partner on self-driving cars

20 Mar 2019

Most Popular

Visit/security/identity-and-access-management-iam/354289/44-million-microsoft-customers-found-using
identity and access management (IAM)

44 million Microsoft customers found using compromised passwords

6 Dec 2019
Visit/cloud/microsoft-azure/354230/microsoft-not-amazon-is-going-to-win-the-cloud-wars
Microsoft Azure

Microsoft, not Amazon, is going to win the cloud wars

30 Nov 2019
Visit/hardware/354237/five-signs-that-its-time-to-retire-it-kit
Sponsored

Five signs that it’s time to retire IT kit

29 Nov 2019
Visit/business/business-strategy/354195/where-modernisation-and-sustainability-meet-a-tale-of-two
Sponsored

Where modernisation and sustainability meet: A tale of two benefits

25 Nov 2019