DigestAI news desk

Cut through the AI noise.

Enterprise & Industry6 min read

AWS shares CDK construct to fix SageMaker AI auto scaling updates

AWS published a technical guide addressing a common failure mode when updating Amazon SageMaker AI real-time endpoints using AWS Cloud Development Kit (CDK). The issue arises because SageMaker requires auto scaling targets to be deregistered before endpoint configuration changes, but CloudFormation cannot track these resources if they are manually removed, leading to deployment failures or…

1 source primary source

Key points

  • Updating SageMaker AI endpoints via CDK fails if auto scaling is not manually deregistered first.
  • A new reusable CDK construct automates deregistering and registering auto scaling during endpoint updates.
  • The solution uses three custom resources and asynchronous patterns to ensure auto scaling persists after changes.

The post introduces a reusable CDK construct that uses three CloudFormation custom resources to automate this process. The construct orchestrates a specific sequence: it deregisters the scalable target, updates the endpoint, waits for the endpoint to reach InService status, and then re-registers the target and applies the scaling policy. This approach uses asynchronous completion patterns to handle waiting periods without timing out, ensuring auto scaling remains intact after configuration changes.

The article provides a walkthrough for deploying the solution, including prerequisites like AWS CDK v2 and Python 3.12. It details how the construct works, noting that while it defines three custom resources, the deployed stack includes additional Lambda functions and Step Functions state machines generated by the CDK provider framework. Users can integrate this construct into existing CDK stacks or deploy the provided example stack to test the workflow.

The story so far

6 episodes →
  1. AWS shares CDK construct to fix SageMaker AI auto scaling updatesthis story
Full story from AWS Machine Learning Blog · by Lauren Eterno primary sourceOpen source ↗

Orchestrating SageMaker AI endpoint auto scaling with AWS CDK

AWS Machine Learning Blog · 23 October 2026

Loading the full article…

This text was published by AWS Machine Learning Blog and written by Lauren Eterno. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗

Topics · follow one to build your own front page

The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.

Comments

via GitHub Discussions

More in Enterprise & Industry

All →

Related stories