{"version":1,"type":"story","url":"https://digestai.news/story/nvidia-says-vera-cpu-delivers-3-4-tb-s-bandwidth-and-higher-single-thr","json":"https://digestai.news/story/nvidia-says-vera-cpu-delivers-3-4-tb-s-bandwidth-and-higher-single-thr.json","markdown":"https://digestai.news/story/nvidia-says-vera-cpu-delivers-3-4-tb-s-bandwidth-and-higher-single-thr.md","slug":"nvidia-says-vera-cpu-delivers-3-4-tb-s-bandwidth-and-higher-single-thr","headline":"NVIDIA’s Vera CPU delivers up to twice the throughput of x86 servers for Modal’s AI sandboxes","summary":"NVIDIA’s Vera CPU, an Arm-based processor with 88 Olympus cores and a monolithic die design, is being adopted by Modal to power its AI Sandboxes, marking Modal’s first shift away from x86 infrastructure. Modal’s internal benchmarks show Vera handling up to twice as many concurrent tasks as equivalent Intel servers under load, particularly due to its high memory bandwidth and resistance to throughput saturation under containerized workloads. NVIDIA positions Vera as a purpose-built CPU for agentic AI, emphasizing low-latency CPU-GPU communication and high single-threaded performance to keep GPUs utilized in AI workflows.\n\nWhile Modal and NVIDIA both highlight Vera’s performance gains in agentic AI and sandbox environments, only Modal provides specific benchmark claims about doubling throughput, and only NVIDIA discloses technical details like the Scalable Coherent Fabric, LPDDR5X memory subsystem, and Spatial Multithreading. The performance figures differ in framing: Modal cites up to 2× task throughput under load, while NVIDIA claims up to 2× x86 performance on agentic workloads and 1.5× over its Grace predecessor. No source disputes the core adoption or architectural intent.\n\nThe reporting is consistent on Vera’s role in enabling agentic AI workloads and Modal’s infrastructure shift, with differences limited to emphasis and granularity of claims.","keyPoints":["Modal plans to run its AI Sandboxes on NVIDIA’s Vera CPU, its first move away from x86 chips.","Modal’s benchmarks show Vera handles up to twice as many tasks as Intel servers under load.","NVIDIA says Vera delivers up to 2× x86 performance on agentic AI workloads and 1.5× over Grace."],"whyItMatters":"The adoption of NVIDIA’s Vera CPU by Modal signals a growing shift toward Arm-based, AI-optimized processors in cloud infrastructure, potentially reducing reliance on traditional x86 servers for agentic AI workloads that demand low-latency CPU-GPU coordination.","category":{"slug":"hardware","name":"Hardware & Compute","url":"https://digestai.news/category/hardware"},"entities":{"companies":["NVIDIA","Modal","Intel","AMD","Amazon","Anthropic"],"models":["Vera","Grace","Vera Rubin GPU","Intel GNR","AMD Zen 5","AWS Graviton 4"],"people":["Jeff Fisher"]},"firstPublishedAt":"2026-10-18T12:00:00Z","updatedAt":"2026-10-20T11:50:00Z","sourceCount":9,"hasPrimarySource":false,"sources":[{"outlet":"wccftech.com","title":"Exclusive: NVIDIA’s Vera Team Says Chiplet Designs Sacrificed Single-Threaded Performance For Core Counts, And Agentic AI Is Now Forcing A Reversal","url":"https://wccftech.com/exclusive-nvidia-vera-team-says-chiplet-designs-sacrificed-single-threaded-performance-for-core-counts-and-agentic-ai-is-now-forcing-a-reversal","publishedAt":"2026-10-18T12:00:00Z","type":"press","primary":false,"lead":true},{"outlet":"Tom's Hardware","title":"Modal taps Nvidia Vera CPUs after firm's internal tests show 2x throughput over Intel and AMD chips","url":"https://tomshardware.com/pc-components/cpus/nvidia-vera-cpu-deployed-at-ai-startup-modal-alongside-existing-x86-fleet-internal-testing-showed-2x-throughput-compared-to-amd-and-intel","publishedAt":"2026-10-20T11:50:00Z","type":"press","primary":false,"lead":false},{"outlet":"techwireasia.com","title":"Nvidia Vera CPUs to power Modal’s AI agents, challenging Intel and AMD","url":"https://techwireasia.com/2026/10/nvidia-vera-cpus-modal-ai-agents","publishedAt":"2026-10-19T17:00:00Z","type":"press","primary":false,"lead":false},{"outlet":"Unite.AI","title":"Modal Plans NVIDIA Vera Rollout for Sandboxes in First Arm Move","url":"https://unite.ai/modal-plans-nvidia-vera-rollout-for-sandboxes-in-first-arm-move","publishedAt":"2026-10-19T16:08:01Z","type":"press","primary":false,"lead":false},{"outlet":"reuters.com","title":"AI infrastructure startup Modal says it plans to start using Nvidia's Vera CPUs for the first time for hosting agents, alongside existing Intel and AMD chips","url":"https://reuters.com/business/nvidia-wins-fast-growing-ai-startup-modal-new-central-processors-2026-10-19","publishedAt":"2026-10-19T15:40:02Z","type":"press","primary":false,"lead":false},{"outlet":"shattered.io","title":"Nvidia Wins Modal CPU Deal, Claims 2x AI Agent Speed","url":"https://shattered.io/nvidia-vera-cpu-modal-ai-agent-deal-2026","publishedAt":"2026-10-19T14:31:00Z","type":"press","primary":false,"lead":false},{"outlet":"thenextweb.com","title":"Modal says Nvidia’s Vera CPU doubles throughput for its AI sandboxes","url":"https://thenextweb.com/news/modal-nvidia-vera-cpu-sandboxes","publishedAt":"2026-10-19T11:00:00Z","type":"press","primary":false,"lead":false},{"outlet":"trendforce.com","title":"[News] NVIDIA Chooses Monolithic Die Over Chiplets for Vera CPU, Claims 2× x86 Performance in Agentic AI","url":"https://trendforce.com/news/2026/10/19/news-nvidia-chooses-monolithic-die-over-chiplets-for-vera-cpu-claims-2x-x86-performance-in-agentic-ai","publishedAt":"2026-10-19T08:13:00Z","type":"press","primary":false,"lead":false},{"outlet":"digitaltrends.com","title":"NVIDIA thinks the CPU industry chased too many cores, and AI agents are bringing single-core speed back","url":"https://digitaltrends.com/computing/nvidia-vera-cpu-chiplet-design-agentic-ai","publishedAt":"2026-10-18T07:24:00Z","type":"press","primary":false,"lead":false}],"sourceNotes":{"agree":"All sources agree that Modal is adopting NVIDIA’s Vera CPU for its AI Sandboxes, marking a shift from x86 to Arm-based infrastructure for agentic AI workloads.","differ":[]},"discussions":[],"thread":{"title":"Microsoft's AI-Fueled Financial Surge and Market Impact","url":"https://digestai.news/thread/microsoft-s-azure-backlog-and-capex-shape-outlook-through-2026","storyCount":6},"cite":{"text":"Digest AI, \"NVIDIA’s Vera CPU delivers up to twice the throughput of x86 servers for Modal’s AI sandboxes\", 18 October 2026, https://digestai.news/story/nvidia-says-vera-cpu-delivers-3-4-tb-s-bandwidth-and-higher-single-thr","publisher":"Digest AI","title":"NVIDIA’s Vera CPU delivers up to twice the throughput of x86 servers for Modal’s AI sandboxes","datePublished":"2026-10-18T12:00:00Z","url":"https://digestai.news/story/nvidia-says-vera-cpu-delivers-3-4-tb-s-bandwidth-and-higher-single-thr"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}