{"version":1,"type":"story","url":"https://digestai.news/story/surge-ai-releases-dayjob-tax-benchmark-testing-ai-agents-on-50-real-ta","json":"https://digestai.news/story/surge-ai-releases-dayjob-tax-benchmark-testing-ai-agents-on-50-real-ta.json","markdown":"https://digestai.news/story/surge-ai-releases-dayjob-tax-benchmark-testing-ai-agents-on-50-real-ta.md","slug":"surge-ai-releases-dayjob-tax-benchmark-testing-ai-agents-on-50-real-ta","headline":"Surge AI releases dayjob: Tax benchmark testing AI agents on 50 real tax tasks","summary":"Surge AI introduced **DAYJOB: Tax**, a new benchmark evaluating AI agents on 50 professional tax assignments. The test covers eight tax practice areas, requiring agents to handle incomplete client requests, conflicting evidence, and consequential deadlines—skills beyond simple calculations or legal questions.\n\nModels like **Claude Sonnet 5.5** (10.8% pass rate) and **Opus 5.5** (9.2%) struggled with real-world complexities. For example, an agent missed a critical deadline for a tax exclusion in Anna’s condo sale scenario, while another failed to verify a couple’s marital status despite conflicting records. The benchmark includes 1,789 workspace files (PDFs, Excel, emails) and was designed by tax experts from firms like **PwC** and **Deloitte**. DAYJOB contrasts with narrower benchmarks like **TaxBench** or **TaxCalcBench**, which focus only on defined problems or calculations, not end-to-end professional judgment.","keyPoints":["DAYJOB: Tax tests AI agents on 50 real tax tasks across eight practice areas, including individual filings and corporate transactions","Claude Sonnet 5.5 leads with a 10.8% pass rate, but models often miss consequential deadlines or conflicting evidence","Benchmark includes 1,789 files (PDFs, Excel, emails) and was reviewed by tax experts from PwC, Deloitte, and Exxon"],"whyItMatters":"This benchmark exposes gaps in AI’s ability to handle messy, real-world tax work—where professionals must spot overlooked issues and make judgments with incomplete data. It highlights that current models still fail basic professional standards, even when individual steps work.","category":{"slug":"agents","name":"Agents & Tools","url":"https://digestai.news/category/agents"},"entities":{"companies":["Surge AI","PwC","Deloitte","Exxon","Baker Tilly"],"models":["Claude Sonnet 5.5","Claude Fable 5.1","Claude Opus 5.5","Astra"],"people":[]},"firstPublishedAt":"2026-10-28T15:46:30Z","updatedAt":"2026-10-28T15:46:30Z","sourceCount":1,"hasPrimarySource":false,"sources":[{"outlet":"surgehq.ai","title":"Dayjob: Tax – evaluating AI agents on 50 professional tax assignments","url":"https://surgehq.ai/blog/dayjob-tax","publishedAt":"2026-10-28T15:46:30Z","type":"press","primary":false,"lead":true}],"sourceNotes":null,"discussions":[{"site":"Hacker News","url":"https://news.ycombinator.com/item?id=50275626","points":60}],"thread":null,"cite":{"text":"Digest AI, \"Surge AI releases dayjob: Tax benchmark testing AI agents on 50 real tax tasks\", 28 October 2026, https://digestai.news/story/surge-ai-releases-dayjob-tax-benchmark-testing-ai-agents-on-50-real-ta","publisher":"Digest AI","title":"Surge AI releases dayjob: Tax benchmark testing AI agents on 50 real tax tasks","datePublished":"2026-10-28T15:46:30Z","url":"https://digestai.news/story/surge-ai-releases-dayjob-tax-benchmark-testing-ai-agents-on-50-real-ta"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}