{"version":1,"type":"story","url":"https://digestai.news/story/researchers-link-ai-agent-power-to-human-goal-attainment-in-formal-mod","json":"https://digestai.news/story/researchers-link-ai-agent-power-to-human-goal-attainment-in-formal-mod.json","markdown":"https://digestai.news/story/researchers-link-ai-agent-power-to-human-goal-attainment-in-formal-mod.md","slug":"researchers-link-ai-agent-power-to-human-goal-attainment-in-formal-mod","headline":"Researchers link AI agent power to human Goal attainment in formal models","summary":"A new paper on arXiv explores how power dynamics between AI agents and humans can be quantified in socio-technical systems. The authors propose two measures: *information-theoretic empowerment*—how much an agent’s actions influence future states—and *capability-based individual power*, which gauges a human’s ability to achieve goals based on probabilistic outcomes. They derive a mathematical relationship showing that empowerment sets an upper bound on *goal revelation*, the mutual information between a human’s latent goal and the realized trajectory, while a lower bound (*B(s)*) is derived from Fano’s inequality.\n\nThe work highlights critical failure modes: an AI maximizing empowerment might prioritize broad influence over irrelevant actions, while one maximizing revelation could mislabel goals without improving outcomes. The authors argue that only *satisfaction floors*—calculated from interaction logs—can reliably monitor human power retention. Simulations suggest the three metrics (empowerment, revelation, and satisfaction) correlate but are not interchangeable.","keyPoints":["Two formal measures of AI-agent power defined: empowerment (action influence) and capability-based individual power (goal attainment)","Goal revelation bounded by empowerment (upper limit) and a satisfaction floor (*B(s)*) derived from Fano’s inequality","Failure modes identified: empowerment-maximizing agents may ignore goal relevance; revelation-maximizing agents may mislabel goals"],"whyItMatters":"This bridges theoretical AI safety with practical human-AI interaction, offering tools to detect power imbalances in deployed systems.","category":{"slug":"research","name":"Research","url":"https://digestai.news/category/research"},"entities":{"companies":[],"models":[],"people":[]},"firstPublishedAt":"2026-11-06T05:00:00Z","updatedAt":"2026-11-06T05:00:00Z","sourceCount":1,"hasPrimarySource":true,"sources":[{"outlet":"arXiv cs.AI","title":"Goal Revelation as a Bridge Between Information-Theoretic Empowerment and Capability-Based Human Power","url":"https://arxiv.org/abs/2611.07247","publishedAt":"2026-11-06T05:00:00Z","type":"primary","primary":true,"lead":true}],"sourceNotes":null,"discussions":[],"thread":null,"cite":{"text":"Digest AI, \"Researchers link AI agent power to human Goal attainment in formal models\", 6 November 2026, https://digestai.news/story/researchers-link-ai-agent-power-to-human-goal-attainment-in-formal-mod","publisher":"Digest AI","title":"Researchers link AI agent power to human Goal attainment in formal models","datePublished":"2026-11-06T05:00:00Z","url":"https://digestai.news/story/researchers-link-ai-agent-power-to-human-goal-attainment-in-formal-mod"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}