IT Pro is supported by its audience. When you purchase through links on our site, we may earn an affiliate commission. Learn more

Twitter to make AI algorithm open source to scour for biases

Users highlight racial bias in the way Twitter’s automated image-cropping tool selects portions for preview

Twitter has committed to open-sourcing its image-cropping machine learning algorithm after users identified potential racial bias.

The social media platform has confirmed it has “more analysis to do” on the algorithm that determines which elements of an image are shown when previewed after users posted examples of potential racial bias in the tool’s application.

Cryptography and infrastructure engineer, Tony Arcieri, conducted an experiment on the platform to highlight how Twitter’s automated image-cropping for previews might prefer white faces over black faces. 

In the experiment, Arcieri used various combinations of a picture showing the faces of former US president Barack Obama and senator Mitch McConnell. Seemingly, regardless of positioning, or other potentially interfering factors such as the colour of the individuals’ tie, the algorithm preferred to show the face of Mitch McConnell in the cropped preview.

Twitter spokesperson Liz Kelley claimed, in response to the experiment, that the company’s own testing prior to the model being shipped found no evidence racial or gender bais present, though admitted further analysis was needed. 

Kelley added that the firm will open source its machine learning algorithm “so others can review and replicate” the results of Arcieri’s experiment and get to the bottom of the issue.

Concerns about bias in artificial intelligence (AI) systems, and especially machine learning, which can often be seen as a black box, are rife, with many arguing that technology companies haven’t prioritised eradicating discrimination in their systems.

Related Resource

Humility in AI: Building trustworthy and ethical AI systems

How humble AI can help safeguard your business

Download now

The escalation of Black Lives Matter protests earlier in the year forced a number of tech companies into reflecting on the potential intrinsic bias present in many of their systems, especially facial recognition technologies.

A wave of organisations, including IBM and Amazon, rushed to either suspend or discontinue facial recognition systems and their use in law enforcement as a result of the movement, for instance.

The number of newly-launched AI-powered systems to have shown racial bias shows that tech companies, on the whole, have much more work to do in stamping this out. Microsoft’s AI news editor on MSN, for example, was shown to have wrongly identified a member of Little Mix in a story about band member Jade Thirlwall’s personal reflections on racism.

Featured Resources

Activation playbook: Deliver data that powers impactful, game-changing campaigns

Bringing together data and technology to drive better business outcomes

Free Download

In unpredictable times, a data strategy is key

Data processes are crucial to guide decisions and drive business growth

Free Download

Achieving resiliency with Everything-as-a-Service (XAAS)

Transforming the enterprise IT landscape

Free Download

What is contextual analytics?

Creating more customer value in HR software applications

Free Download

Recommended

Elon Musk offers to buy Twitter for $41.39 billion, claiming only he can 'unlock its true potential'
social media

Elon Musk offers to buy Twitter for $41.39 billion, claiming only he can 'unlock its true potential'

14 Apr 2022
Jack Dorsey admits regret for helping to centralise the internet
Network & Internet

Jack Dorsey admits regret for helping to centralise the internet

4 Apr 2022
IT Pro News In Review: Cyber attack at Ikea, Meta ordered to sell Giphy, new Twitter CEO
cyber security

IT Pro News In Review: Cyber attack at Ikea, Meta ordered to sell Giphy, new Twitter CEO

3 Dec 2021
Jack Dorsey resigns as Twitter CEO
business management

Jack Dorsey resigns as Twitter CEO

29 Nov 2021

Most Popular

16 ways to speed up your laptop
Laptops

16 ways to speed up your laptop

13 May 2022
Linux-based Cheerscrypt ransomware found targeting VMware ESXi servers
ransomware

Linux-based Cheerscrypt ransomware found targeting VMware ESXi servers

26 May 2022
Open source packages with millions of installs hacked to harvest AWS credentials
hacking

Open source packages with millions of installs hacked to harvest AWS credentials

24 May 2022