{"version":1,"type":"story","url":"https://digestai.news/story/semianalysis-drops-ai-agents-below-12-on-realistic-work-tests","json":"https://digestai.news/story/semianalysis-drops-ai-agents-below-12-on-realistic-work-tests.json","markdown":"https://digestai.news/story/semianalysis-drops-ai-agents-below-12-on-realistic-work-tests.md","slug":"semianalysis-drops-ai-agents-below-12-on-realistic-work-tests","headline":"SemiAnalysis drops AI agents below 12% on realistic work tests","summary":null,"keyPoints":["No AI agent scores above 12 percent on SemiAnalysis' new real-world work benchmark GDPx.","Claude Opus 5.5 leads with 12 percent, followed by Gemini 4 Carbon (10.9%) and GPT-6 Astra (9.6%).","Critics question the test's realism and safety filters impact on results."],"whyItMatters":"The benchmark highlights significant gaps in AI capabilities for real-world tasks, challenging industry expectations.","category":{"slug":"enterprise","name":"Enterprise & Industry","url":"https://digestai.news/category/enterprise"},"entities":{"companies":["SemiAnalysis","Claude Opus 5.5","Gemini 4 Carbon","GPT-6 Astra"],"models":["Claude Opus 5.5","Gemini 4 Carbon","GPT-6 Astra"],"people":[]},"firstPublishedAt":"2026-11-05T16:46:24Z","updatedAt":"2026-11-05T16:46:24Z","sourceCount":1,"hasPrimarySource":false,"sources":[{"outlet":"The Decoder","title":"No AI agent scores above 12 percent on SemiAnalysis' new real-world work benchmark","url":"https://the-decoder.com/no-ai-agent-scores-above-12-percent-on-semianalysis-new-real-world-work-benchmark","publishedAt":"2026-11-05T16:46:24Z","type":"press","primary":false,"lead":true}],"sourceNotes":null,"discussions":[],"thread":{"title":"AI Model Showdown Claude Opus Dominates Benchmarks","url":"https://digestai.news/thread/replit-ends-partnership-with-anthropic-cites-cost-and-performance","storyCount":7},"cite":{"text":"Digest AI, \"SemiAnalysis drops AI agents below 12% on realistic work tests\", 5 November 2026, https://digestai.news/story/semianalysis-drops-ai-agents-below-12-on-realistic-work-tests","publisher":"Digest AI","title":"SemiAnalysis drops AI agents below 12% on realistic work tests","datePublished":"2026-11-05T16:46:24Z","url":"https://digestai.news/story/semianalysis-drops-ai-agents-below-12-on-realistic-work-tests"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}