Orca Security cuts cloud query costs by 90% with Amazon Bedrock agent
Orca Security partnered with AWS to build Discovery AI, a natural language query agent on Amazon Bedrock that converts plain-text security questions into structured cloud queries. The tool reduces query costs by 90%, input tokens by 93%, and latency by 75% compared to its initial baseline, handling thousands of daily requests since March 2026.
Key points
- Discovery AI slashes query costs by **90%** and input tokens by **93%** using Amazon Bedrock’s multi-model pipeline
- Latency drops from **60 seconds to 15 seconds** per request via staged model allocation and RAG-based retrieval
- Human labeling system lets Orca experts refine examples in real time, improving accuracy for evolving cloud environments
The system uses a nine-stage pipeline with specialized models—including Anthropic Claude Haiku 4.5 for reasoning and Amazon Titan for embeddings—to parse user requests, filter irrelevant models, and validate outputs. A human-in-the-loop labeling system continuously improves accuracy by letting domain experts correct misclassified queries. Orca’s Sonar platform supports 900+ cloud models, but the agent dynamically narrows context to only relevant schemas, avoiding the inefficiency of loading all definitions at once.
The story so far
10 episodes →- Orca Security cuts cloud query costs by 90% with Amazon Bedrock agentthis story
Natural language security queries at Orca Security using Amazon Bedrock
AWS Machine Learning Blog · 13 October 2026
Loading the full article…
This text was published by AWS Machine Learning Blog and written by Deniz Yilmaz. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Agents & Tools
All →- OpenAI rolls out ChatGPT dots for Pro and Business Premium users · 2 src
- Former Plaud exec Peter Mo raises $26M for Ambi AI app that listens continuously · 1 src
- PolyAI CTO says voice AI has not yet reached its ChatGPT moment · 1 src
- User tests local AI on Apple Mac Studio and RTX Spark · 1 src
- AI agents enter messaging apps to handle tasks without apps · 1 src
Comments
via GitHub Discussions