{"version":1,"type":"story","url":"https://digestai.news/story/amazon-sagemaker-adds-training-session-apis-for-custom-llm-loops","json":"https://digestai.news/story/amazon-sagemaker-adds-training-session-apis-for-custom-llm-loops.json","markdown":"https://digestai.news/story/amazon-sagemaker-adds-training-session-apis-for-custom-llm-loops.md","slug":"amazon-sagemaker-adds-training-session-apis-for-custom-llm-loops","headline":"Amazon SageMaker adds training session APIs for custom LLM loops","summary":"Amazon SageMaker AI introduces training session APIs that let developers write their own training loops in Python while the service runs the GPU‑bound operations. The APIs expose core steps such as forwardbackward(), optimstep() and sample() as SageMaker calls, keeping the model loaded on managed accelerators and handling distribution, fault recovery and checkpointing.\n\nBilling is per token processed, so only the GPU‑bound calls incur cost and idle‑GPU time is not charged. The blog shows a reinforcement‑learning example on the GSM8K math benchmark and a larger code‑generation task where a LoRA adapter for GPT‑OSS 20B is trained for 50 steps on 128 problems with eight responses each, raising reward from 0.46 to 0.60 and held‑out accuracy from 40% to 50.5%. A cookbook of ready‑to‑run recipes is released alongside the APIs.\n\nThe new feature targets teams that need algorithmic flexibility—custom loss functions, RL reward signals, multi‑stage pipelines—without provisioning GPU clusters. It fits between fully managed serverless model customization and self‑managed SageMaker training jobs, offering faster iteration and predictable spend for advanced LLM fine‑tuning and alignment research.","keyPoints":["Training session APIs let users call forwardbackward, optimstep, and sample as SageMaker API operations, keeping the model loaded on GPUs.","Billing is per token processed, so only GPU-bound calls incur cost, eliminating idle‑GPU charges.","In a demo, a LoRA adapter for GPT‑OSS 20B trained 50 steps on 128 problems, raising reward from 0.46 to 0.60."],"whyItMatters":"The APIs give ML teams fine‑grained control over training algorithms while offloading GPU management, lowering costs and speeding experimentation for custom LLM fine‑tuning and RL workloads.","category":{"slug":"enterprise","name":"Enterprise & Industry","url":"https://digestai.news/category/enterprise"},"entities":{"companies":["Amazon","AWS","SageMaker"],"models":["GPT-OSS 20B"],"people":["Arun Nagarajan","Xichao Wang","Shruti Sharma"]},"firstPublishedAt":"2026-10-22T18:00:01Z","updatedAt":"2026-10-22T18:00:04Z","sourceCount":2,"hasPrimarySource":true,"sources":[{"outlet":"AWS Machine Learning Blog","title":"Write your own training loop — without managing GPUs — with Amazon SageMaker training session APIs","url":"https://aws.amazon.com/blogs/machine-learning/write-your-own-training-loop-without-managing-gpus-with-amazon-sagemaker-training-sessions","publishedAt":"2026-10-22T18:00:01Z","type":"primary","primary":true,"lead":true},{"outlet":"AWS Machine Learning Blog","title":"Announcing new ways to customize models with SageMaker AI, without managing GPUs","url":"https://aws.amazon.com/blogs/machine-learning/announcing-new-ways-to-customize-models-with-sagemaker-ai-without-managing-gpus","publishedAt":"2026-10-22T18:00:04Z","type":"primary","primary":true,"lead":false}],"sourceNotes":null,"discussions":[],"thread":{"title":"AWS Expands SageMaker AI Agent Capabilities","url":"https://digestai.news/thread/aws-shows-how-contextual-bandits-lift-conversions-in-acquisition-funnels","storyCount":5},"cite":{"text":"Digest AI, \"Amazon SageMaker adds training session APIs for custom LLM loops\", 22 October 2026, https://digestai.news/story/amazon-sagemaker-adds-training-session-apis-for-custom-llm-loops","publisher":"Digest AI","title":"Amazon SageMaker adds training session APIs for custom LLM loops","datePublished":"2026-10-22T18:00:01Z","url":"https://digestai.news/story/amazon-sagemaker-adds-training-session-apis-for-custom-llm-loops"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}