MIT researchers hail "liquid" algorithm breakthrough

A set of differential equations at the base of an algorithm could lead to a more adaptable type of machine learning

A digital depiction of a neural network

Researchers at MIT say they have developed a flexible algorithm that can change its underlying equations to continuously adapt to new inputs of data.

The "liquid" algorithm is said to be a new type of neural network that learns during tasks rather than just in its initial training phase.

It's hoped this new approach could revolutionise technology that relies on decision-making protocols where the data changes over time, or in unpredictable environments, such as medical diagnosis or autonomous driving.

The research will be presented at the AAAI Conference, an artificial intelligence event taking place in Vancouver, Canada, in February.

"This is a way forward for the future of robot control, natural language processing, video processing - any form of time series data processing," says Ramin Hasani, the study's lead author. "The potential is really significant."

Most neural networks have fixed behaviour and they typically don't adjust all that well to changes in incoming data streams. For example, the crash of an Uber autonomous vehicle in 2018 that resulted in the death of Elaine Herzberg, considered the first fatality involving the technology, was said to have been caused by the system being unable to identify the shape of a pedestrian when they were walking alongside a bicycle.

Related Resource

Unleashing the power of AI initiatives with the right infrastructure

What key infrastructure requirements are needed to implement AI effectively?

What key infrastructure requirements are needed to implement AI effectively?Download now

The neural network designed by Hasani has the potential to avoid these issues by using a set of differential equations as the base of its algorithm, potentially creating a more fluid type of machine learning. The idea is inspired by the microscopic nematode, Caenorhabditis (C) elegans, which has only 302 neurons in its nervous system. Hasani said they can still "generate unexpectedly complex dynamics".

Similarly, Hasani and his team used equations that allowed the parameters of his neural network to change over time. These are essentially a nested set of differential equations that change the representation of the neuron, creating a small number of highly "expressive" ones, according to Hasani.

"We have a provably more expressive neural network that is inspired by nature," Hasani said. "But this is just the beginning of the process. The obvious question is how do you extend this? We think this kind of network could be a key element of future intelligence systems."

Featured Resources

The ultimate law enforcement agency guide to going mobile

Best practices for implementing a mobile device program

Free download

The business value of Red Hat OpenShift

Platform cost savings, ROI, and the challenges and opportunities of Red Hat OpenShift

Free download

Managing security and risk across the IT supply chain: A practical approach

Best practices for IT supply chain security

Free download

Digital remote monitoring and dispatch services’ impact on edge computing and data centres

Seven trends redefining remote monitoring and field service dispatch service requirements

Free download

Most Popular

Best Linux distros 2021
operating systems

Best Linux distros 2021

11 Oct 2021
HPE wins networking contract with Birmingham 2022 Commonwealth Games
Network & Internet

HPE wins networking contract with Birmingham 2022 Commonwealth Games

15 Oct 2021
What is cyber warfare?
Security

What is cyber warfare?

15 Oct 2021