Lost the remote? Use your cat

British researchers unveil gesture recognition system that works with any object

Forget digging around in couch cushions for the missing remote British researchers have developed a solution that uses gesture recognition to turn everything into a controller, from your hand to your cup of tea, or even your pet cat.

Researchers at the University of Lancaster have unveiled "Matchpoint", saying the gesture system lets devices be controlled via movement of the body or objects using only a webcam. Different targets are shown on the screen corresponding to a menu, volume or channel, for example with the user moving the object or their hand to turn up the sound or switch channels.

Advertisement - Article continues below

Called "spontaneous spatial coupling," the gesture control system doesn't need to be trained using a specific object, it simply looks for anything rotating or moving in the correct way. 

"Spontaneous spatial coupling is a new approach to gesture control that works by matching movement instead of asking the computer to recognise a specific object," said Christopher Clarke, PhD student at Lancaster and author of the paper on the technology, which is set to be unveiled at a conference later this month.

When engaged, the system shows sliders on the screen; to control them, the user moves their hand, object or head in the right direction.

Advertisement - Article continues below

That means you can turn up the volume of a YouTube tutorial without downing tools, for example. The gesture control system also works with multiple users, handy for interactive whiteboards in a meeting, and supports using two hands to zoom in and rotate images.

"Our method allows for a much more user-friendly experience where you can change channels without having to put down your drink, or change your position, whether that is relaxing on the sofa or standing in the kitchen following a recipe," Clarke said.

Advertisement - Article continues below

While meeting attendees or Netflix watchers can easily "de-couple" their hands so they cease acting as controllers, the system also lets users link an object to controls to be used as a remote for a longer time period. That means your favourite mug could be used to change a music track when moved to a new position, the researchers said, or a toy car be used to adjust volume, though the objects lose their remote control powers when out of the camera's field of view.

"Everyday objects in the house can now easily become remote controls so there are no more frantic searches for remote controls when your favourite programme is about to start on another channel, and now everyone in the room has the remote'," said Clarke. "You could even change the channel with your pet cat." That said, it may well be easier to dig the remote out of the back of the couch than convince your feline friend to change the channel for you.

Gesture controls have met with limited success in computers and VR, with Leap Motion embedded in some HP laptops for a brief time. The researchers admit the technology is an academic prototype, so don't expect it to arrive with your next TV anytime soon.

Featured Resources

The case for a marketing content hub

Transform your digital marketing to deliver customer expectations

Download now

Fast, flexible and compliant e-signatures for global businesses

Be at the forefront of digital transformation with electronic signatures

Download now

Why CEOS should care about the move to SAP S/4HANA

And how they can accelerate business value

Download now

IT faces new security challenges in the wake of COVID-19

Beat the crisis by learning how to secure your network

Download now

Most Popular

Microsoft Windows

Microsoft warns users not to install Windows 10's May update

28 May 2020
Server & storage

Dell EMC PowerEdge R7525 review: An EPYC core density to make Intel weep

26 May 2020
Network & Internet

Intel releases Wi-Fi and Bluetooth driver updates for Windows 10

26 May 2020