IT Pro is supported by its audience. When you purchase through links on our site, we may earn an affiliate commission. Learn more

Doctors reject AI chatbot that is 'more accurate than a GP'

Royal College of GPs say no app can replace human physicians

The Royal College of General Practitioners (RCGP) has dismissed claims a chatbot can diagnose medical conditions as accurately as a GP.

Babylon Health unveiled its new bot at an event held at the Royal College of Physicians yesterday, saying it allows patients to contact the bot via an app without an appointment, with the bot offering health advice based on what patients tell it.

The company said the chatbot, Babylon AI, has achieved medical exam scores of the same level as or higher than a human doctor.

But its claims were disputed by the RCGP.

"No app or algorithm will be able to do what a GP does," said Professor Martin Marshall, vice chair of the RCGP.

"Every day we deliver care to more than a million people across the UK, taking into account the physical, psychological and social factors that may be impacting on a patient's health."

"The potential of technology to support doctors to deliver the best possible patient care is fantastic, but at the end of the day, computers are computers, and GPs are highly-trained medical professionals; the two can't be compared and the former may support but will never replace the latter," he said.

Professor Marshall added that while an app can pass an automated clinical knowledge test, in real life, clinical scenarios don't always have "cut and dried" answers.

Babylon Health said its new Babylon AI tool took part in a series of robust tests, including the relevant sections of the MRCGP exam, which is the final test for a trainee GP and set by the Royal College of GPs.

The average pass mark over the past five years for real-life doctors is 72%, whereas Babylon's AI scored 81%.

Ali Parsa, Babylon's founder and CEO, said the results showed how AI can globally support healthcare and provide accurate health advice regardless of circumstance.

"Tonight's results clearly illustrate how AI-augmented health services can reduce the burden on healthcare systems around the world," Dr Parsa said.

"Our mission is to put accessible and affordable health services into the hands of every person on Earth. These landmark results take humanity a significant step closer to achieving a world where no-one is denied safe and accurate health advice."

The company is also behind the NHS's GP at Hand app, which allows patients at five London clinics to consult with their GP via a video call.

But the College also publicly criticised the GP at Hand app for "cherry-picking" patients, leaving traditional GP services to deal with the most complex patients without sufficient resources, and does not endorse Babylon, or its GP at Hand service, being used in this way by in the NHS.

"Technology has the potential to transform the NHS, but it must be implemented in an equitable way that doesn't benefit some patients, and not others, and is not to the detriment of the general practice service as a whole," Marshall said.

Picture: Babylon Health founder Ali Parsa at Wednesday's launch

Featured Resources

Accelerating AI modernisation with data infrastructure

Generate business value from your AI initiatives

Free Download

Recommendations for managing AI risks

Integrate your external AI tool findings into your broader security programs

Free Download

Modernise your legacy databases in the cloud

An introduction to cloud databases

Free Download

Powering through to innovation

IT agility drive digital transformation

Free Download

Recommended

DHSC sets out ambitious targets for NHS App by 2023, beyond
Business strategy

DHSC sets out ambitious targets for NHS App by 2023, beyond

29 Jun 2022
Secretary of State retires NHS Digital and NHSX
public sector

Secretary of State retires NHS Digital and NHSX

23 Nov 2021

Most Popular

Former Uber security chief to face fraud charges over hack coverup
data breaches

Former Uber security chief to face fraud charges over hack coverup

29 Jun 2022
Macmillan Publishers hit by apparent cyber attack as systems are forced offline
Security

Macmillan Publishers hit by apparent cyber attack as systems are forced offline

30 Jun 2022
FCC commissioner urges Apple and Google to remove TikTok from app stores
data protection

FCC commissioner urges Apple and Google to remove TikTok from app stores

29 Jun 2022