AWS launches human review service for machine learning models

Amazon A2I aims to help incorporate human judgment into machine learning applications

AWS has launched a service that improves machine learning model accuracy by continuously identifying and improving low confidence predictions. 

Amazon Augmented Artificial Intelligence (A2I), which is now generally available, allows for human review of model predictions using reviewers from Mechanical Turk, third-party vendors, or an organisations' own employees.

The service aims to help developers build human review systems, structure the review process and manage the review workforce. AWS suggests that developers could use A2I to quickly spin up and manage a workforce of humans to review and validate the accuracy of machine learning predictions. 

This could be used for an application that collects financial information from scanned mortgage documents or even one that uses image recognition to identify counterfeit items online. The idea is that the review helps the predictive model get better over time. 

A2I could be used by AWS customers that use services such as Amazon SageMaker, Amazon Rekognition or Amazon Textract, which are often used in critical and sensitive cases that need often need human judgements. 

"Even with these advancements, our customers still say there are critical use cases where human judgment is required like in law enforcement investigations or times when human review can be used to resolve the ambiguity in predictions when confidence levels fall below a given threshold for less sensitive use cases, and the current human review process involves a lot of custom effort and cost," said Swami Sivasubramanian, VP for Amazon Machine Learning."

Related Resource

The IT expert’s guide to AI and content management

Your guide to the biggest opportunities for IT teams when it comes to AI and content management

Download now

A2I is already being used by a number of organisations, including the National Health Service (NHS) Business Services Authority, which provides a range of support services to NHS organisations, NHS contractors, and patients. The organisation processes 54 million paper prescriptions each month, according to AWS. 

"Human judgment is critical and in fact is often required for decisions involving medical payments," said Chris Suter, the head of cloud platforms and innovation at NHS BSA.

Featured Resources

Choosing a collaboration platform

Eight questions every IT leader should ask

Download now

Performance benchmark: PostgreSQL/ MongoDB

Helping developers choose a database

Download now

Customer service vs. customer experience

Three-step guide to modern customer experience

Download now

Taking a proactive approach to cyber security

A complete guide to penetration testing

Download now

Recommended

10 keys to AI success in 2021
Whitepaper

10 keys to AI success in 2021

10 Mar 2021
MLOps 101: The foundation for your AI strategy
Whitepaper

MLOps 101: The foundation for your AI strategy

10 Mar 2021
How to choose an AI vendor
Whitepaper

How to choose an AI vendor

10 Mar 2021
Realising the benefits of automated machine learning
Whitepaper

Realising the benefits of automated machine learning

10 Mar 2021

Most Popular

REvil threatens to release Apple’s hardware schematics
ransomware

REvil threatens to release Apple’s hardware schematics

21 Apr 2021
How to find RAM speed, size and type
Laptops

How to find RAM speed, size and type

8 Apr 2021
Samsung Galaxy S21 Ultra review: Ultra in every sense of the word
Mobile Phones

Samsung Galaxy S21 Ultra review: Ultra in every sense of the word

22 Apr 2021