EU proposes strict regulations to curb AI misuse

The draft regulations call for the use of systems that allow ‘social scoring' by governments to be banned

The European Commission (EC) has proposed a new set of wide-reaching regulations that aim to combat the misuse of artificial intelligence (AI).

Under the draft regulations, EU citizens will be protected from the use of AI for mass surveillance by law enforcement, which was ruled unlawful in the UK last year. The use of AI in recruitment, credit score evaluation, as well as border control management will be also be classified as "high-risk” due to discrimination concerns, while systems that allow ‘social scoring' by governments will be banned.

The 100-page document, long-awaited by digital rights campaigners, aims to deliver “harmonised rules” on AI across the EU’s 27 member states and proposes “laying down effective, proportionate and dissuasive penalties for their infringement”. Similarly to the fines imposed by GDPR reaches, companies that break the rules face fines up to 6% of their global turnover or €30 million, whichever is the higher figure.

Commenting on the newly-drafted rules, the EC's executive vice president for the digital age Margrethe Vestager said that, regarding AI, “trust is a must, not a nice to have”. 

Related Resource

AI thought leadership digest

Expert outlook on the future of AI

AI thought leadership digest - whitepaper from DataRobotDownload now

“With these landmark rules, the EU is spearheading the development of new global norms to make sure AI can be trusted. By setting the standards, we can pave the way to ethical technology worldwide and ensure that the EU remains competitive along the way. Future-proof and innovation-friendly, our rules will intervene where strictly needed: when the safety and fundamental rights of EU citizens are at stake,” she added.

BCS, The Chartered Institute for IT stated that, by directly prohibiting the use of AI for indiscriminate surveillance and social scoring, the new AI legislation sets Europe on a different path to the US and China. BCS director of Policy, Dr Bill Mitchell OBE, said that “there will be a huge amount of work to do to professionalise large sections of the economy ready for this sweeping legislation”.

“These ambitious plans to make AI work for the good of society will be impossible to deliver without a fully professionalised AI industry. Those with responsibility for adopting and managing AI will need to ensure their systems comply with these new regulations, as well as those designing and developing these systems,”  he added.

Mitchell also predicts that “those involved in AI” will need to provide “evidence they have behaved ethically, competently and transparently”. 

“In principle this is something we should all welcome, and it will help restore public trust in AI systems that are used to make high stakes decisions about people,” he added.

The EC will now have to thrash out the details of the proposed regulations with EU national governments and the European Parliament before the rules can come into force, a process that can take a number of years. 

Featured Resources

Preparing for AI-enabled cyber attacks

MIT technology review insights

Download now

Cloud storage performance analysis

Storage performance and value of the IONOS cloud Compute Engine

Download now

The Forrester Wave: Top security analytics platforms

The 11 providers that matter most and how they stack up

Download now

Harness data to reinvent your organisation

Build a data strategy for the next wave of cloud innovation

Download now

Most Popular

RMIT to be first Australian university to implement AWS supercomputing facility
high-performance computing (HPC)

RMIT to be first Australian university to implement AWS supercomputing facility

28 Jul 2021
Square to acquire Afterpay for $29 billion
mergers and acquisitions

Square to acquire Afterpay for $29 billion

2 Aug 2021
Zyxel USG Flex 200 review: A timely and effective solution
Security

Zyxel USG Flex 200 review: A timely and effective solution

28 Jul 2021