Contrastive-LM releases CLM-8B, an open model scoring actions up to 9x faster than Jev
Contrastive-LM has released CLM-8B, described as the first open model in the Contrastive Language Models (CLMs) class. Unlike traditional generative models, CLM-8B does not generate text; instead, it scores candidate actions against a current state and returns probabilities. The model uses a frozen Qwen3-8B backbone with a small trainable projection head, allowing it to run on a single NVIDIA…
Key points
- CLM-8B is an open-source model that scores actions rather than generating text, using a Qwen3-8B backbone.
- The model runs up to 9 times faster than TypeSafe AI's Jev in zero-shot tests on specific tasks.
- Fine-tuned CLM heads achieve 81.6% on DeepSWE and 87.6% on Terminal-Bench 2.1 subsets as a verifier.
The release targets the same interface as Jev, a proprietary System One model from TypeSafe AI that entered limited early access on 15 September 2026. CLM-8B exposes three question types: Noul (truth probability), Choice (option selection), and Score (rubric evaluation). In zero-shot tests, the research team reports CLM-8B runs up to 9 times faster than Jev, particularly in tasks with repeated actions like the T-Rex game. While it matches Jev on some tasks, it trails on tool calling and WikiRacing.
For coding agents, CLM-8B acts as a verifier to select the best solution from multiple candidates. Using fine-tuned heads, the team reports 81.6% accuracy on DeepSWE and 87.6% on Terminal-Bench 2.1 subsets, claiming these are new state-of-the-art verifier results. These figures are based on held-out subsets rather than full leaderboard submissions. The model’s architecture allows for cached state vectors, reducing latency in agent loops from 1.7 ms to 0.6 ms on an RTX 4090.
The story so far
4 episodes →- Contrastive-LM releases CLM-8B, an open model scoring actions up to 9x faster than Jevthis story
Contrastive-LM Releases CLM-8B: An Open System One Model That Scores Agent Actions Up to 9× Faster Than Jev
MarkTechPost · 24 September 2026
Loading the full article…
This text was published by MarkTechPost and written by Michal Sutter. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
Coverage and discussion
2sources- Reddit discussionreddit.com
- Contrastive Language ModelsPress · contrastive-lm.notion.site ·
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Generative AI & Models
All →- Anthropic launches Claude Opus 5.5, claims 40% lower running costs than Opus 5 · 33 src
- Xiaomi releases MiMo-V2.6-Pro-RL, a 1.02T/42B open omnimodal model trained via scaled RL · 6 src
- Claude edges ChatGPT and Gemini in 1000-character story test · 1 src
- OpenAI and Anthropic release new AI models with 40-50% price cuts · 36 src
- Anthropic has a 71% chance of leading AI model market by end of 2026 · 1 src
Comments
via GitHub Discussions