Google brings AI to edge devices

The cloud giant's new TPU chip makes it possible for IoT devices to run machine learning models

Google has announced its first purpose-built chip designed to help companies run machine learning models across IoT networks and the edge.

The Edge tensor processing unit (TPU) is an ASIC chip designed to handle machine learning models at the edge, upgrading IoT sensors from data harvesters to devices that can make inferences based on what they collect.

The idea is that by allowing much of the data analysis to occur at the very edge of the network, it's far easier and quicker to train the machine learning algorithms sat in the cloud. For example, a CCTV camera fitted with an Edge TPU chip would not only capture video, but perform facial recognition on the feed before it arrives at the server.

What's more, given that the chips are only making inferences rather than training the models themselves, they operate at a fraction of the power of machine learning hardware. Google was keen to show off that you could fit four Edge TPUs on a single US penny (see main picture).

Advertisement
Advertisement - Article continues below

Supporting machine learning models running on Edge TPUs is Google's newly-announced Cloud IoT Edge. This software can also underpin ML algorithms powered by GPUs or GPU-based accelerators, and can run on devices powered by the venfor's IoT operating system Android Things as well as Linux.

The software connects to the Cloud IoT Core, a managed service Google announced last year that was set up to connect IoT devices directly to its cloud platform.

Google claims this will make it far easier for businesses to build use cases around machine learning - with a bulk of the data analysis being done at the edge, companies don't need to worry about maintaining reliable connections with the cloud, or worry about regulations that mean it's simpler for companies to comply by just storing data on-premise.

Cloud IoT Edge is capable of analysing images, videos, gestures, acoustics and motion locally on the device, the company claims.

The Edge TPU development kit will be available in October

"We are the only cloud vendor today to have combined our AI research, our software research, and our hardware research to build together a hardware that is truly optimised for the latest and greatest AI technology," said Antony Passemard, head of product management for Cloud IoT.

"This is a game changer for IoT. This is really bringing intelligence to the edge in a very efficient manner in terms of watts consumed or price point," he added.

In order to test the new hardware and software, Google will be releasing a development kit in October that includes a system on module (SOM), featuring a quad-core CPU, a crypto-chip for added security, and the Edge TPU built in.

This SOM can be placed on top of a base board that the company has also developed, which will add connectivity options like Wifi and USB-C, as well as local storage.

For early access to the kit ahead of the October release, developers can submit a request through this form.

Advertisement
Advertisement - Article continues below

Pictures courtesy of Google

Featured Resources

The IT Pro guide to Windows 10 migration

Everything you need to know for a successful transition

Download now

Managing security risk and compliance in a challenging landscape

How key technology partners grow with your organisation

Download now

Software-defined storage for dummies

Control storage costs, eliminate storage bottlenecks and solve storage management challenges

Download now

6 best practices for escaping ransomware

A complete guide to tackling ransomware attacks

Download now
Advertisement

Recommended

Visit/email-clients/19598/hotmail-outlookcom-upgrades-your-questions-answered
Software

Hotmail.co.uk migration to Outlook.com: Qs answered

11 Nov 2019
Visit/careers/28219/it-manager-job-description-what-does-an-it-manager-do
Careers & training

IT manager job description: What does an IT manager do?

28 Oct 2019
Visit/business-strategy/31780/the-it-pro-panel
Business strategy

The IT Pro Panel

28 Oct 2019
Visit/security/ddos/28039/how-to-protect-against-a-ddos-attack
Security

How to protect against a DDoS attack

25 Oct 2019

Most Popular

Visit/security/identity-and-access-management-iam/354289/44-million-microsoft-customers-found-using
identity and access management (IAM)

44 million Microsoft customers found using compromised passwords

6 Dec 2019
Visit/cloud/microsoft-azure/354230/microsoft-not-amazon-is-going-to-win-the-cloud-wars
Microsoft Azure

Microsoft, not Amazon, is going to win the cloud wars

30 Nov 2019
Visit/hardware/354237/five-signs-that-its-time-to-retire-it-kit
Sponsored

Five signs that it’s time to retire IT kit

29 Nov 2019
Visit/business/business-strategy/354195/where-modernisation-and-sustainability-meet-a-tale-of-two
Sponsored

Where modernisation and sustainability meet: A tale of two benefits

25 Nov 2019