Companies to combat AI bias with forensic experts

New breed of specialist could help avoid in-built prejudice and rebuild consumer confidence

racial bias or racial profiling concept

Large businesses are about to start recruiting a new type of AI specialist with gusto, but perhaps not of the kind you may expect.

Incidents such as facial recognition software that consistently classified black women as 'male', or concluded that convicts with darker skin were more likely to reoffend than their white counterparts, as well as algorithms denying people loans based solely on where they lived, have led to accusations of built-in racism, classism and sexism in AI systems. This, in turn, has led to decreasing consumer confidence in this new technology.

In order to combat these inherent biases  and restore consumer trust by 2023 75% of large businesses will hire AI behaviour forensic, privacy and trust experts, according to research firm Gartner.

"New tools and skills are needed to help organisations identify these and other potential sources of bias, build more trust in using AI models, and reduce corporate brand and reputation risk, said Jim Hare, research vice president at Gartner.

This new breed of expert will help organisations avoid inherent bias in their systems by validating models in the research and development stage, and continue to monitor them once they're in production.

Some big names have already got in on this trend, including Facebook, Google (which was stung by a racist AI scandal in 2015), Bank of America and NASA. For the moment, however, they remain very much trailblazers.

"While the number of organisations hiring ML (machine learning) forensic and ethics investigators remains small today, that number will accelerate in the next five years," said Hare.

Featured Resources

Four cyber security essentials that your board of directors wants to know

The insights to help you deliver what they need

Download now

Data: A resource much too valuable to leave unprotected

Protect your data to protect your company

Download now

Improving cyber security for remote working

13 recommendations for security from any location

Download now

Why CEOS should care about the move to SAP S/4HANA

And how they can accelerate business value

Download now

Recommended

Workday's Accounting Center helps businesses manage financial data
chief financial officer (CFO)

Workday's Accounting Center helps businesses manage financial data

30 Oct 2020
MarqVision detects counterfeit products with deep learning and AI
intellectual property

MarqVision detects counterfeit products with deep learning and AI

18 Sep 2020
The IT Pro Podcast: Attack of the AI hackers
artificial intelligence (AI)

The IT Pro Podcast: Attack of the AI hackers

14 Aug 2020
MIT develops AI tech to edit outdated Wikipedia articles
artificial intelligence (AI)

MIT develops AI tech to edit outdated Wikipedia articles

13 Feb 2020

Most Popular

46 million Animal Jam accounts leaked after comms software breach
Security

46 million Animal Jam accounts leaked after comms software breach

13 Nov 2020
macOS Big Sur is bricking some older MacBooks
operating systems

macOS Big Sur is bricking some older MacBooks

16 Nov 2020
How computing has revolutionised Formula 1
Sponsored

How computing has revolutionised Formula 1

11 Nov 2020