Agents & Tools21 October 2026, 16:03 UTC8 min read

AI agent fixed the bug, but what else did it change?

Trail of Bits announced two open‑source plugins, patching-bugs and regression-hunt, built with OpenAI under the joint "Patch the Planet" initiative. The tools let engineers delegate bug reproduction, fix generation, and regression checking to AI agents, while giving maintainers control through threat‑model and patching‑guideline files.

1 source HN 42

Key points

Regression‑hunt cuts false‑positive regression findings by 25% versus a baseline Codex agent (95% CI 14‑38%).
Evaluation found 21 confirmed regressions among 58 candidates (≈36% precision) from over 130 merged PRs.
Plugins were co‑created by Trail of Bits and OpenAI, using strict schemas, live PoCs, and threat‑model integration.

In internal evaluations, regression‑hunt reduced false‑positive regression findings by 25% compared with a baseline Codex agent, with a 95% confidence interval of 14% to 38%. Across more than 130 merged pull requests, the system identified 21 confirmed regressions from 58 candidate findings (about 36% precision). The plugins enforce strict input/output schemas, live proof‑of‑concept runs, and modular steps that can be used independently. Future work will add configurable rules, broader evaluation metrics, and deeper analysis of agent trace data.

The release aims to standardize patch development and regression validation, helping projects move from bug reports to reliable patches faster while keeping security and quality safeguards in place.

Full story from blog.trailofbits.com · by "Anish Naik, Marcelo Morales" · via Hacker NewsOpen source ↗