IT Pro is supported by its audience. When you purchase through links on our site, we may earn an affiliate commission. Learn more

Scientists build drones capable of detecting violence in crowds

But the algorithm gets less accurate the more people it tries to track

Scientists have trained drones to recognise violent behaviour in crowds using AI.

In a paper called Eye in the Sky, researchers from Cambridge University and India's technology and sciences institutes detailed how they fed an alogirthm videos of human poses to help their camera-fitted drones detect people committing violent acts.

The researchers claim the system boasts a 94% accuracy rate at identifying violent poses,and works in three steps: first the AI detects humans from aerial images, then it uses a system called "ScatterNet Hybrid Deep Learning" to interpret the pose of each detected human and finally the orientation of the limbs in the estimated pose are numbered and joined up like a coloured skeleton to identify individuals.

The algorithm used by the AI is trained to match five poses the researchers have deemed violent, which are classified as strangling, punching, kicking, shooting and stabbing.

Volunteers acted out the poses to train the AI, but they were generously spaced out and used exaggerated movements whilst acting out attacks. The report explains that the larger the crowd, and the more violent individuals within it, the less accurate the AI becomes.

"The accuracy of the Drone Surveillance System (DSS) decreases with the increase in the number of humans in the aerial image. This can be due to the inability of the FPN network to locate all the humans or the incapability of the SHDL network to estimate the pose of the humans accurately," the researchers wrote. "The incorrect pose can result in a wrong orientation vector which can lead the SVM to classify the activities incorrectly."

When one violent individual is in the crowd, the system is 94.1% accurate, which reduces to 90.6% with two, down to 88.3% for three, 87.8% for 4 and 84% for five violent individuals. By those figures, tracking violence in widespread incidents like the 2011 riots would currently be unworkable.

AI-powered recognition software is already in use among law enforcement bodies, despite fears that it is not accurate enough.

Both the Metropolitan Police and South Wales Police were accused of using dangerously inaccurate facial recognition technology by privacy campaign groups last month.

The groups revealed the Met had a failure rate of 98% when using facial recognition to identify suspects at last year's Notting Hill Carnival and that South Wales Police misidentified 2,400 innocent people and stored their information without their knowledge.

Image: Shutterstock

Featured Resources

Accelerating AI modernisation with data infrastructure

Generate business value from your AI initiatives

Free Download

Recommendations for managing AI risks

Integrate your external AI tool findings into your broader security programs

Free Download

Modernise your legacy databases in the cloud

An introduction to cloud databases

Free Download

Powering through to innovation

IT agility drive digital transformation

Free Download

Most Popular

Former Uber security chief to face fraud charges over hack coverup
data breaches

Former Uber security chief to face fraud charges over hack coverup

29 Jun 2022
Macmillan Publishers hit by apparent cyber attack as systems are forced offline
Security

Macmillan Publishers hit by apparent cyber attack as systems are forced offline

30 Jun 2022
FCC commissioner urges Apple and Google to remove TikTok from app stores
data protection

FCC commissioner urges Apple and Google to remove TikTok from app stores

29 Jun 2022