# Parsimony, an open-source benchmark, measures code added by AI models

Digest AI · Research · published 2026-10-08T00:00:00Z

Canonical: https://digestai.news/story/parsimony-an-open-source-benchmark-measures-code-added-by-ai-models

## Summary

A new open-source tool called Parsimony has been introduced to address a gap in current AI coding benchmarks. While existing metrics focus on solve rates and costs, they often ignore the volume of code generated, which can complicate long-term maintenance. Parsimony quantifies this by counting "coding units" such as statements, calls, and literals in patches produced by AI models, subtracting any deleted code to find a net total.

The benchmark uses data from SWE-bench Verified to rank models by the mean net units added on tasks they solved, with lower scores indicating more concise code. The tool notes that smaller code is not always better, as size does not equate to readability or design quality. It also highlights a correlation where models that write more code tend to solve more tasks, with a Spearman correlation of 0.33–0.60 observed on boards with 26 or more models.

Parsimony is limited to Python and relies on published pass/fail results rather than rerunning tests. Users can add their own benchmark data by filling in a provided example file, which processes the data locally in the browser to generate charts and tables. The project aims to provide a clearer picture of code efficiency alongside traditional performance metrics.

## Key points

- Parsimony measures net coding units added by AI models, subtracting deleted code to assess conciseness.
- The benchmark uses SWE-bench Verified data and ranks models by mean net units added on solved tasks.
- It is limited to Python and notes that code size does not directly correlate with readability or design quality.

## Why it matters

This tool helps developers and companies evaluate AI coding assistants not just for accuracy, but for the maintainability of the code they generate, preventing codebase bloat.

## Sources

1. [Show HN: Parsimony – an open-source benchmark for how much code AI models add](https://parsimony.lasu.dev/) (parsimony.lasu.dev, 2026-10-08)

## Cite

Digest AI, "Parsimony, an open-source benchmark, measures code added by AI models", 8 October 2026, https://digestai.news/story/parsimony-an-open-source-benchmark-measures-code-added-by-ai-models

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/parsimony-an-open-source-benchmark-measures-code-added-by-ai-models.json