Robot uses deep learning to compose and play original music

Shimon learns from great musicians to compose his own masterpieces

Researchers have trained Shimon, a robot with AI and deep learning capabilities, to create its own original musical scores.

The marimba-playing robot has four arms and eight sticks, which it uses to perform its music. Like all great musicians, Shimon learned from the great composers of the past. Georgia tech researchers fed the robot around 5,000 songs by classical masterminds like Beethoven, and pop icons like the Beatles and Lady Gaga. The robot was also given over two million motifs, riffs, and licks of music.

Advertisement - Article continues below

First, researchers gave the robot four measures of music to get it started, which is the only human involvement in the composing process. The first two compositions recorded were about half a minute long each.

But Shimon wasn't always a solo act. Ph.D. student Mason Bretan has worked with Shimon for seven years, programming it to listen to and analyse music played by humans and improvise over precomposed chord progressions.

Now that Shimon is a composer in its own right, it generates the melody and harmonic structure independently.

Unlike its earlier days of improvising, when it played monophonically (only one note at a time), Shimon is now able to play harmonies and chords. It's learned to operate much more like a human musician, focusing less on the next note and more on the overall structure of the musical piece.

Advertisement
Advertisement - Article continues below

The robot's musical style sounds like a mix between classical and jazz. Hear it for yourself here.

Picture credit: Georgia Tech

Featured Resources

Top 5 challenges of migrating applications to the cloud

Explore how VMware Cloud on AWS helps to address common cloud migration challenges

Download now

3 reasons why now is the time to rethink your network

Changing requirements call for new solutions

Download now

All-flash buyer’s guide

Tips for evaluating Solid-State Arrays

Download now

Enabling enterprise machine and deep learning with intelligent storage

The power of AI can only be realised through efficient and performant delivery of data

Download now
Advertisement

Most Popular

Visit/security/privacy/355155/zoom-kills-facebook-integration-after-data-transfer-backlash
privacy

Zoom kills Facebook integration after data transfer backlash

30 Mar 2020
Visit/security/data-breaches/355173/marriott-hit-by-data-breach-exposing-personal-data-of-52-million
data breaches

Marriott data breach exposes personal data of 5.2 million guests

31 Mar 2020
Visit/security/cyber-crime/355171/fbi-warns-of-zoom-bombing-hackers-amidst-coronavirus-usage-spike
cyber crime

FBI warns of ‘Zoom-bombing’ hackers amid coronavirus usage spike

31 Mar 2020
Visit/data-insights/data-management/355170/oracle-cloud-courses-are-free-during-coronavirus-lockdown
data management

Oracle cloud courses are free during coronavirus lockdown

31 Mar 2020