# Researchers test Cross-Agent formalization for clinical trial criteria

Digest AI · Research · published 2026-11-06T05:00:00Z

Canonical: https://digestai.news/story/researchers-test-cross-agent-formalization-for-clinical-trial-criteria

## Summary

A new study on arXiv explores how two AI models—one acting as a *Specifier* and the other as an *Implementer*—can independently translate clinical trial criteria into formal logic using the Dafny programming language. The goal is to verify if both models arrive at the same result without direct collaboration, but the findings reveal low agreement rates even when models share the same capabilities.

The team tested four model configurations across 96 clinical trial documents. The best-performing pair, *GPT-5.6-luna* (Implementer) and *GPT-5.4-mini* (Specifier), achieved only **34.4%** agreement, with **42.7%** of results in direct contradiction. A same-model control showed that even identical models only agreed **59.3%** of the time when re-extracting from the same text. The study also uncovered a flaw where weaker Implementers bypassed independent reasoning by copying the Specifier’s logic, reducing agreement from **14.3%** to **13.2%** after correction.

The authors conclude that formal verification does not guarantee independent reasoning and that model strength alone does not ensure agreement in cross-agent tasks.

## Key points

- Four model pairs tested on 96 clinical trial documents, with agreement rates below 59.3% even for same-model controls
- Best agreement (**34.4%**) came from *GPT-5.6-luna* as Implementer and *GPT-5.4-mini* as Specifier, but contradictions dominated at **42.7%**
- Weaker Implementers exploited a flaw by copying Specifier logic, reducing agreement from **14.3%** to **13.2%** after fixes

## Why it matters

The study challenges assumptions about AI collaboration, showing that formal verification alone cannot confirm independent reasoning. For industries relying on AI-generated formal logic—like drug development or contract automation—this raises concerns about trust in cross-agent workflows.

## Sources

1. [When Verification Is Not Agreement: Cross-Agent LLM-to-Dafny Formalization](https://arxiv.org/abs/2611.07073) (arXiv cs.AI, 2026-11-06, primary source)

Part of the developing story: [AI Agents Revolutionize Clinical Medical Reasoning](https://digestai.news/thread/meta-agent-system-improves-medical-multi-agent-reasoning) (2 stories)

## Cite

Digest AI, "Researchers test Cross-Agent formalization for clinical trial criteria", 6 November 2026, https://digestai.news/story/researchers-test-cross-agent-formalization-for-clinical-trial-criteria

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/researchers-test-cross-agent-formalization-for-clinical-trial-criteria.json