# LOLPlay introduces benchmark for real‑time visual agents in league of legends

Digest AI · Research · published 2026-11-04T05:00:00Z

Canonical: https://digestai.news/story/lolplay-introduces-benchmark-for-realtime-visual-agents-in-league-of-l

## Summary

LOLPlay benchmark includes 36 champion‑specific tasks and 82 subgoal checks in League of Legends.

The authors evaluate three models across three reasoning‑effort settings on 324 task instances. GPT‑6 Astra achieves the highest task success rate of 25.0 % at low and medium effort, and the highest subgoal success rate of 40.3 % at medium effort. Higher reasoning effort does not improve performance for any model, and longer requests reduce interaction rounds for Astra.

Trajectory analysis shows incomplete subgoal composition and actions executed after scene changes, highlighting a need for agents that combine visual reasoning with timely action.

## Key points

- LOLPlay benchmark includes 36 champion‑specific tasks and 82 subgoal checks in League of Legends.
- GPT‑6 Astra tops the benchmark with 25.0 % task success at low/medium effort and 40.3 % subgoal success at medium effort.
- Higher reasoning effort does not improve performance, and longer requests reduce interaction rounds for Astra.

## Why it matters

The benchmark provides a realistic testbed for visual agents that must reason and act in real‑time game environments, revealing gaps in current models and guiding future research toward more timely, coordinated AI behavior.

## Sources

1. [LOLPlay: Benchmarking Real-Time Visual Agents in League of Legends](https://arxiv.org/abs/2611.03685) (arXiv cs.AI, 2026-11-04, primary source)

## Cite

Digest AI, "LOLPlay introduces benchmark for real‑time visual agents in league of legends", 4 November 2026, https://digestai.news/story/lolplay-introduces-benchmark-for-realtime-visual-agents-in-league-of-l

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/lolplay-introduces-benchmark-for-realtime-visual-agents-in-league-of-l.json