AWS ramps up SageMaker tools at Re:Invent

Cloud giant loads more capabilities into its machine learning hub with AWS SageMaker Studio

CEO Andy Jassy announced a barrage of new machine learning capabilities for AWS SageMaker during his re:Invent keynote on Tuesday.

SageMaker is Amazon's big machine learning hub that aims to remove most of the heavy lifting for developers and let them use ML more expansively. Launched in 2017, there have been numerous features and capabilities introduced over the years, with more than 50 added to it in 2019 alone.

Of the SageMaker announcements made at the company's annual conference in Las Vegas, the biggest was AWS SageMaker Studio, an IDE that allows developers and data scientists to build, code, develop, train and tune machine learning workflows all in a single interface. Within it information can be viewed, stored, collected and used to collaborate with others through the studio.

In addition to SageMaker Studio, the company announced a further five new capabilities: Notebooks, Experiment Management, Autopilot, Debugger and Model Monitor.

Advertisement
Advertisement - Article continues below
Advertisement - Article continues below

The first of these is described as a 'one-click' notebook with elastic compute.

"In the past, Notebooks is frequently where data scientists would work and it was associated with a single EC2 instance," explained Larry Pizette, the global head of ML solutions Lab. "If a developer or data scientist wanted to switch capabilities, so they wanted more compute capacity, for instance, they had to shut that down and instantiate a whole new notebook.

"This can now be done dynamically, in just seconds, so they can get more compute or GPU capability for doing training or inference, so its a huge improvement over what was done before."

All of the updates to SageMaker have a specific purpose to simplify the machine learning workflows, like Experiment Management, which enables developers to visualise and compare ML model iterations, training parameters, and outcomes.

Autopilot lets developers submit simple data in CSV files and have ML models automatically generated. SageMaker Debugger provides real-time monitoring for ML models to improve predictive accuracy, reduce training times.

And finally, Amazon SageMaker Model Monitor detects concept drift to discover when the performance of a model running in production begins to deviate from the original trained model.

Advertisement - Article continues below

"We recognised that models get used over time and there can be changes to the underlying assumptions that the models were built with - such as housing prices which inflate," said Pizette. "If interest rates change it will affect the prediction of whether a person will by a home or not."

"When the model is initially built to keep statistics, it will notice what we call 'Concept Drift' if that concept drift is happening, and the model gets out of sync with the current conditions, it will identify where that's happening and provide the developer or data scientist with the information to help them retrain and retool that model."

The company also announced a ML service to help write code - AWS Code Guru. This is an automated tool that's been trained on several decades of code reviews at Amazon, according to the company. If it discovers an issue, it will add human-readable comments to pull requests that identify lines of code with a specific issue and recommended remediation, including example code and links to relevant documentation.

Featured Resources

Digitally perfecting the supply chain

How new technologies are being leveraged to transform the manufacturing supply chain

Download now

Three keys to maximise application migration and modernisation success

Harness the benefits that modernised applications can offer

Download now

Your enterprise cloud solutions guide

Infrastructure designed to meet your company's IT needs for next-generation cloud applications

Download now

The 3 approaches of Breach and Attack Simulation technologies

A guide to the nuances of BAS, helping you stay one step ahead of cyber criminals

Download now
Advertisement

Recommended

Visit/technology/33253/toyota-partners-with-nvidia-to-create-the-future-of-autonomous-vehicles
Technology

Toyota, NVIDIA partner on self-driving cars

20 Mar 2019

Most Popular

Visit/business-strategy/mergers-and-acquisitions/354602/xerox-to-nominate-directors-to-hps-board-reports
mergers and acquisitions

Xerox to nominate directors to HP's board – reports

22 Jan 2020
Visit/operating-systems/25802/17-windows-10-problems-and-how-to-fix-them
operating systems

17 Windows 10 problems - and how to fix them

13 Jan 2020
Visit/business-strategy/public-sector/354608/uk-gov-launches-ps300000-sen-edtech-initiative
public sector

UK gov launches £300,000 SEN EdTech initiative

22 Jan 2020
Visit/web-browser/30394/what-is-http-error-503-and-how-do-you-fix-it
web browser

What is HTTP error 503 and how do you fix it?

7 Jan 2020