Doctors bested by AI in breast cancer detection
Google's research could support radiographers in diagnosing the condition in future
Working with DeepMind, Cancer Research UK Imperial Centre, Northwestern University and Royal Surrey County Hospital, the organisation set out to create a piece of software that could spot breast cancer in mammograms more accurately than expert radiologists.
The AI was trained on a data set comprising mammograms from over 76,000 women in the UK and more than 15,000 women in the US. It was then tested on images from a different set of 25,000 UK and 3,000 US women.
Compared to radiologists, the AI produced a marked reduction in false positives for the US (5.7%), and a more modest reduction in false positives for the UK (1.2%). It was even more successful at reducing false negatives, producing a 9.7% fall in this type of error for the US and a 2.7% reduction in the UK.
The creators also ran a separate test to determine how effective it is across healthcare systems, by training it on only UK data then testing it against US data. In this scenario, it produced a 3.5% reduction in false positives and 8.1% reduction in false negatives.
The researchers believe this “sets the stage” for a future where radiologists are supported by AI in the diagnostic process for increased accuracy, particularly in the UK, which is facing a shortage of consultant radiologists in the NHS.
In a blog post, Shravya Shetty, technical lead of Google Health and Daniel Tse, product manager of Google Health, said: “There are some promising signs that the model could potentially increase the accuracy and efficiency of screening programs, as well as reduce wait times and stress for patients.”
They added, however, that “getting there will require continued research, prospective clinical studies and regulatory approval to understand and prove how software systems inspired by this research could improve patient care”.
The initial findings of the research have been published in full in the journal Nature.