# Surge AI releases dayjob: Tax benchmark testing AI agents on 50 real tax tasks

Digest AI · Agents & Tools · published 2026-10-28T15:46:30Z

Canonical: https://digestai.news/story/surge-ai-releases-dayjob-tax-benchmark-testing-ai-agents-on-50-real-ta

## Summary

Surge AI introduced **DAYJOB: Tax**, a new benchmark evaluating AI agents on 50 professional tax assignments. The test covers eight tax practice areas, requiring agents to handle incomplete client requests, conflicting evidence, and consequential deadlines—skills beyond simple calculations or legal questions.

Models like **Claude Sonnet 5.5** (10.8% pass rate) and **Opus 5.5** (9.2%) struggled with real-world complexities. For example, an agent missed a critical deadline for a tax exclusion in Anna’s condo sale scenario, while another failed to verify a couple’s marital status despite conflicting records. The benchmark includes 1,789 workspace files (PDFs, Excel, emails) and was designed by tax experts from firms like **PwC** and **Deloitte**. DAYJOB contrasts with narrower benchmarks like **TaxBench** or **TaxCalcBench**, which focus only on defined problems or calculations, not end-to-end professional judgment.

## Key points

- DAYJOB: Tax tests AI agents on 50 real tax tasks across eight practice areas, including individual filings and corporate transactions
- Claude Sonnet 5.5 leads with a 10.8% pass rate, but models often miss consequential deadlines or conflicting evidence
- Benchmark includes 1,789 files (PDFs, Excel, emails) and was reviewed by tax experts from PwC, Deloitte, and Exxon

## Why it matters

This benchmark exposes gaps in AI’s ability to handle messy, real-world tax work—where professionals must spot overlooked issues and make judgments with incomplete data. It highlights that current models still fail basic professional standards, even when individual steps work.

## Sources

1. [Dayjob: Tax – evaluating AI agents on 50 professional tax assignments](https://surgehq.ai/blog/dayjob-tax) (surgehq.ai, 2026-10-28)

## Cite

Digest AI, "Surge AI releases dayjob: Tax benchmark testing AI agents on 50 real tax tasks", 28 October 2026, https://digestai.news/story/surge-ai-releases-dayjob-tax-benchmark-testing-ai-agents-on-50-real-ta

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/surge-ai-releases-dayjob-tax-benchmark-testing-ai-agents-on-50-real-ta.json