# Researchers introduce Schema Coherence Inventory to test belief consistency in language models

Digest AI · Research · published 2026-10-26T04:00:00Z

Canonical: https://digestai.news/story/researchers-introduce-schema-coherence-inventory-to-test-belief-consis

## Summary

A new tool called the Schema Coherence Inventory (SCI) helps assess whether a language model’s assigned beliefs shape its behavior or if it merely mimics emotional tone. Developed by researchers and published on arXiv, the SCI uses 96 forced-choice questions across eight levels of Beck’s cognitive model, scoring responses via log-likelihood without generating or parsing text. The method distinguishes between belief-driven behavior and affective responses by testing whether a model’s output aligns with its assigned belief more than with opposing ones.

Validation across five model backbones (ranging from 1.7B to 14B parameters) and 107 conditions shows the SCI’s reliability. Clinically trained raters correctly identified the intended belief 79.5% of the time, compared to a 16.7% chance baseline. The tool also outperformed existing patient simulators, which failed to consistently reflect their core beliefs. The researchers release the SCI’s items, scoring code, and a shorter 48-item version, proposing it as a template for affective measurement in AI.

## Key points

- Schema Coherence Inventory (SCI) tests if language models act on assigned beliefs or just mimic emotional tone
- Uses 96 forced-choice questions scored by log-likelihood, validated across five model sizes (1.7B–14B params)
- Clinically trained raters matched intended beliefs 79.5% of the time, outperforming existing patient simulators

## Why it matters

The SCI provides a standardized way to measure whether AI agents truly embody assigned beliefs or just adopt superficial emotional cues, improving trust and reliability in affective AI applications like therapy simulators or virtual assistants.

## Sources

1. [The Schema Coherence Inventory: Measuring Whether an Assigned Belief Organizes a Language Model's Cognition](https://arxiv.org/abs/2610.31683) (arXiv cs.CL, 2026-10-26, primary source)

## Cite

Digest AI, "Researchers introduce Schema Coherence Inventory to test belief consistency in language models", 26 October 2026, https://digestai.news/story/researchers-introduce-schema-coherence-inventory-to-test-belief-consis

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/researchers-introduce-schema-coherence-inventory-to-test-belief-consis.json