NousResearch fine-tunes Qwen3.8-27B into Arete-27B to reduce propaganda in responses
NousResearch released Arete-27B, a fine-tuned version of Alibaba’s Qwen3.8-27B model, designed to reduce politically biased responses. The team targeted seven value categories—including freedom of expression, state ideology, and environmental policy—by supervised fine-tuning on 52.8 million tokens. Evaluation showed fact scores rising from 2.32 to 2.98 out of 5 and propaganda in answers dropping…
Key points
- NousResearch fine-tuned Qwen3.8-27B into Arete-27B to reduce propaganda in responses, scoring 2.98/5 on fact recall vs. 2.32
- Training used 52.8M tokens across seven value categories, with no RL or architectural changes applied
- Evaluation dataset of 803 prompts shows propaganda in answers dropped from 22% to 0.9%, with no capability regression
The project used a custom dataset of 803 prompts, judged by Grok 4.7, to measure factual accuracy and propaganda alignment. Training data was generated from English-language government sources, with strict deduplication to avoid overlap with the evaluation set. The team emphasizes that Arete-27B is intended for research and users seeking alternative value alignments, not as a definitive fix for all biases. The model’s training pipeline and dataset are open-sourced for further experimentation.
Model page: Grok 4.7 →
NousResearch/Arete-27B · Hugging Face (Qwen finetune)
huggingface.co · 6 November 2026
Loading the full article…
This text was published by huggingface.co. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
Coverage and discussion
1source- Reddit discussionreddit.com
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Generative AI & Models
All →- Google releases Gemini Omni 1.2 Flash with 15-second video clips at $0.07 per second · 9 src
- Ricursive Intelligence releases Ripple-65B Preview, a 65B model with 1M context · 3 src
- Maritaca AI releases S5-nano 4B model with 262144-token window · 1 src
- Thinking Machines Lab releases Inkling 2 Small with 594B parameters and 17B active parameters · 7 src
- OpenAI leaks GPT-6.2 Bell model with 10 trillion parameters, 87% benchcad 2.0 score · 1 src
Comments
via GitHub Discussions