Microsoft unveils 'largest ever' AI natural language model

T-NLG has over twice as many parameters as Nvidia’s MegatronLM

Microsoft has revealed its largest deep learning language model, the Turing Natural Language Generation (T-NLG), which is claimed to have a record-breaking 17 billion parameters.

The T-NLG, according to Microsoft, outperforms the largest deep learning models to date: the University of Washington’s Grover-Mega and Nvidia’s MegatronLM, which possess 1.5 and 8.3 billion parameters, respectively.

According to Microsoft, the T-NLG is capable of completing unfinished sentences, as well as generating direct answers to questions and can create summaries of documents fed into it. 

Microsoft also claims that the model has the ability to directly answer the question with a complete sentence. 

“This capability is more important outside of web search—for example, this can power AI assistants to intelligently respond when a user asks a question about their personal data such as emails or Word documents,” explained Microsoft’s applied scientist Corby Rosset.

He also thanked the DeepSpeed Library and the ZeRO optimiser for producing “breakthroughs” without which “this work would not be possible”.

Providing an example of how the T-NLG works, the language model introduced itself by generating a summary of its skills:

“Turing Natural Language Generation (T-NLG) is a 17 billion parameter language model by Microsoft that outperforms the state of the art on many downstream NLP tasks. We present a demo of the model, including its freeform generation, question answering, and summarization capabilities, to academics for feedback and research purposes,” said the T-NLG.

Featured Resources

How to choose an AI vendor

Five key things to look for in an AI vendor

Download now

The UK 2020 Databerg report

Cloud adoption trends in the UK and recommendations for cloud migration

Download now

2021 state of email security report: Ransomware on the rise

Securing the enterprise in the COVID world

Download now

The impact of AWS in the UK

How AWS is powering Britain's fastest-growing companies

Download now

Recommended

Taming the machine: AI Governance
artificial intelligence (AI)

Taming the machine: AI Governance

29 Apr 2021
Panasonic finalizes deal to acquire supply chain firm Blue Yonder
Acquisition

Panasonic finalizes deal to acquire supply chain firm Blue Yonder

23 Apr 2021
10 keys to AI success in 2021
Whitepaper

10 keys to AI success in 2021

10 Mar 2021
MLOps 101: The foundation for your AI strategy
Whitepaper

MLOps 101: The foundation for your AI strategy

10 Mar 2021

Most Popular

How to find RAM speed, size and type
Laptops

How to find RAM speed, size and type

16 Jun 2021
Ten-year-old iOS 4 recreated as an iPhone app
iOS

Ten-year-old iOS 4 recreated as an iPhone app

10 Jun 2021
What is HTTP error 400 and how do you fix it?
Network & Internet

What is HTTP error 400 and how do you fix it?

16 Jun 2021