# AWS adds WhisperX to SageMaker for speaker-labeled audio transcription

Digest AI · Enterprise & Industry · published 2026-09-24T16:20:12Z

Canonical: https://digestai.news/story/aws-adds-whisperx-to-sagemaker-for-speaker-labeled-audio-transcription

## Summary

AWS released a **WhisperX**-based deep learning container for **Amazon SageMaker** that adds **speaker diarization** and **per-word timestamps** to OpenAI’s Whisper model. The container supports **real-time** (60-second cap) and **asynchronous** (unlimited duration) endpoints, with outputs in **JSON, SRT, or VTT** formats. It handles **contact-center calls, legal depositions, and media transcripts**, enabling compliance checks, sentiment analysis, and automated captioning at scale.

The solution requires **GPU instances** (e.g., `ml.g4dn.xlarge` or `ml.g5.2xlarge`) and **S3 buckets** for async workflows. AWS provides a **JupyterLab notebook** for deployment, with best practices like **AMI pinning**, **autoscaling**, and **S3 security**. The container is pre-configured with Whisper, **wav2vec2 alignment**, and diarization weights, eliminating the need for manual model setup.

## Key points

- WhisperX container adds speaker labels and per-word timestamps to OpenAI’s Whisper model for SageMaker
- Supports real-time (60s cap) and async endpoints with S3 integration for long audio processing
- Outputs in JSON, SRT, or VTT formats; requires GPU instances and S3 buckets for async workflows

## Why it matters

This tool bridges gaps in generic speech-to-text for regulated industries (legal, healthcare) and media, enabling precise transcription with speaker attribution and timestamps. It reduces manual review time for compliance and automates captioning for large audio libraries.

## Sources

1. [Speaker-labeled transcription with WhisperX on SageMaker AI](https://aws.amazon.com/blogs/machine-learning/speaker-labeled-transcription-with-whisperx-on-sagemaker-ai) (AWS Machine Learning Blog, 2026-09-24, primary source)

## Cite

Digest AI, "AWS adds WhisperX to SageMaker for speaker-labeled audio transcription", 24 September 2026, https://digestai.news/story/aws-adds-whisperx-to-sagemaker-for-speaker-labeled-audio-transcription

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/aws-adds-whisperx-to-sagemaker-for-speaker-labeled-audio-transcription.json