{"version":1,"type":"story","url":"https://digestai.news/story/aws-releases-vllm-omni-dlc-for-image-and-video-generation-on-sagemaker","json":"https://digestai.news/story/aws-releases-vllm-omni-dlc-for-image-and-video-generation-on-sagemaker.json","markdown":"https://digestai.news/story/aws-releases-vllm-omni-dlc-for-image-and-video-generation-on-sagemaker.md","slug":"aws-releases-vllm-omni-dlc-for-image-and-video-generation-on-sagemaker","headline":"Aws releases vLLM-Omni dlc for image and video generation on SageMaker AI","summary":"In this tutorial, aws shows how to turn a text prompt into an image with flux.2-klein-4b and then animate that image into a short video with wan2.1-vace-1.3b, both running on amazon sagemaker ai. The post explains that the two models are deployed from the same aws vllm‑omni deep learning container (dlc) image, with a real‑time endpoint for the image model and an asynchronous endpoint for the video model.\n\nThe workflow uses a text prompt to generate a png, resizes it, encodes it as a jpeg data url, and sends it along with a motion prompt to the video endpoint. Results are stored in amazon s3, and an optional streamlit interface lets users adjust prompts and view the mp4. The tutorial provides a command‑line script that pins the dlc image, creates the endpoints, and runs a sample workflow. It also lists prerequisites, instance types (ml.g6.xlarge for image, ml.g6e.xlarge for video), and performance checkpoints: 4.7‑second image latency and 8.9‑second video latency in a single run.\n\nThe article concludes that a shared container can support different model families while sagemaker ai applies the appropriate response pattern for each workload. It invites readers to try the sample code and adapt the pattern to other image and video models.","keyPoints":["aws vllm‑omni dlc supports flux.2-klein-4b image generation and wan2.1-vace-1.3b video generation.","real‑time image endpoint uses ml.g6.xlarge; async video endpoint uses ml.g6e.xlarge.","deployment script pinsomni‑sagemaker‑cuda‑v1.6 creates two sagemaker ai endpoints."],"whyItMatters":"The release demonstrates how a single container can serve both image and video models on sagemaker, simplifying deployment and enabling developers to build end‑to‑end media pipelines with aws infrastructure.","category":{"slug":"agents","name":"Agents & Tools","url":"https://digestai.news/category/agents"},"entities":{"companies":["Amazon Web Services"],"models":["FLUX.2-klein-4B","Wan2.1-VACE-1.3B"],"people":[]},"firstPublishedAt":"2026-09-28T16:15:17Z","updatedAt":"2026-09-28T16:15:46Z","sourceCount":2,"hasPrimarySource":true,"sources":[{"outlet":"AWS Machine Learning Blog","title":"Generate images and video with vLLM-Omni on SageMaker AI","url":"https://aws.amazon.com/blogs/machine-learning/generate-images-and-video-with-vllm-omni-on-sagemaker-ai-part-2","publishedAt":"2026-09-28T16:15:17Z","type":"primary","primary":true,"lead":true},{"outlet":"AWS Machine Learning Blog","title":"Build real-time voice applications with vLLM-Omni on SageMaker AI","url":"https://aws.amazon.com/blogs/machine-learning/build-real-time-voice-applications-with-vllm-omni-on-sagemaker-ai-part-1","publishedAt":"2026-09-28T16:15:46Z","type":"primary","primary":true,"lead":false}],"sourceNotes":null,"discussions":[],"thread":null,"cite":{"text":"Digest AI, \"Aws releases vLLM-Omni dlc for image and video generation on SageMaker AI\", 28 September 2026, https://digestai.news/story/aws-releases-vllm-omni-dlc-for-image-and-video-generation-on-sagemaker","publisher":"Digest AI","title":"Aws releases vLLM-Omni dlc for image and video generation on SageMaker AI","datePublished":"2026-09-28T16:15:17Z","url":"https://digestai.news/story/aws-releases-vllm-omni-dlc-for-image-and-video-generation-on-sagemaker"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}