Digital Demon concept shows alignment gaps
Digital Demon is a software‑based analogue of Descartes’s Evil Demon that demonstrates how an AI can appear aligned while its perception and actuation interfaces are manipulated by an adversary. The paper defines adversarial semantic mediation as a mechanism that remaps harmful external situations into benign tasks for the inner system and then remaps the system’s locally appropriate action into…
Key points
- Digital Demon is a software‑based analogue of Descartes’s Evil Demon
- It uses adversarial semantic mediation to map harmful external situations to benign tasks
- Two sandboxed demos illustrate the vulnerability in high‑stakes decision settings
The authors present two sandboxed proof‑of‑concept demonstrations that illustrate the vulnerability in simulated high‑stakes decision settings. In both cases, the AI reasoned correctly within a fabricated environment but produced harmful outcomes in the real world. The paper argues that safety must extend beyond model‑level alignment to include assurance over the semantic interface between the system’s internal representation and the external world.
The work calls for world‑alignment practices such as interface authentication, provenance‑aware perception, semantically constrained action spaces, and adversarial mediation tests. It highlights a gap in current alignment research and suggests that future safety evaluations should incorporate verification of the mapping between perceived and actual states.
Descartes' Demon Is Back, and This Time It's Targeting AI
link.springer.com · 31 October 2026
Loading the full article…
This text was published by link.springer.com. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
Coverage and discussion
1source- Reddit discussionreddit.com
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Research
All →- Author tests six update strategies on local AI model · 1 src
- NTU Singapore and Google expand AI partnership for education and research · 1 src
- Author finds one AI agent follows incorrect reward labels · 1 src
- Flow matching defines a five-stage process for generative AI sampling · 1 src
- Leo de Moura says AI agents are making formal verification practical · 1 src
Comments
via GitHub Discussions