IT Pro is supported by its audience. When you purchase through links on our site, we may earn an affiliate commission. Learn more

Microsoft demos real-time language translation

New software lets English speakers talk in Mandarin in user’s own voice

Microsoft Translate

Microsoft has demoed new software that translates English into Mandarin in real-time, copying the speaker's own voice.

In a video posted online, head of Microsoft research, Rick Rashid, demonstrated how the software works. The clip shows Rashid speaking in English with a Mandarin translation spoken a few seconds later copying the tonality of his own voice.

He said the company hopes to have "systems that can completely break down language barriers" in the next few years.

At the core of the software is a technology called Deep Neural Net (DNN) translation. The technology has already been offered as a commercial service called inCus.

The system records the words in English, translates them into Mandarin and then matches them to a recorded set of words in that language.

Rashid said in a blog post that Microsoft was poised to take the system one step further.

The demo was performed at Microsoft Research Asia's 21st Century Computing event. He said his team had been able to reduce the word error rate for speech by over 30 per cent compared to previous methods.

"This means that, rather than having one word in four or five incorrect, now the error rate is one word in seven or eight," said Rashid.

"While still far from perfect, this is the most dramatic change in accuracy since the introduction of hidden Markov modelling in 1979, and as we add more data to the training we believe that we will get even better results."

He said that we would not have to wait until the 22nd century for a usable equivalent of Star Trek's universal translator.

"We can also hope that as barriers to understanding language are removed, barriers to understanding each other might also be removed," he said.

The demo can be watched in the video below.

Featured Resources

The state of Salesforce: Future of business

Three articles that look forward into the changing state of Salesforce and the future of business

Free Download

The mighty struggle to migrate SAP to the cloud may be over

A simplified and unified approach to delivering Enterprise Transformation in the cloud

Free Download

The business value of the transformative mainframe

Modernising on the mainframe

Free Download

The Total Economic Impact™ Of IBM FlashSystem

Cost savings and business benefits enabled by FlashSystem

Free Download

Most Popular

Cyber attack on software supplier causes "major outage" across the NHS
cyber attacks

Cyber attack on software supplier causes "major outage" across the NHS

8 Aug 2022
Why convenience is the biggest threat to your security
Sponsored

Why convenience is the biggest threat to your security

8 Aug 2022
How to boot Windows 11 in Safe Mode
Microsoft Windows

How to boot Windows 11 in Safe Mode

29 Jul 2022