# StarSkirmish Bench v0.2 ranks GPT-6 Astra as top StarCraft bot writer

Digest AI · Research · published 2026-10-16T14:18:44Z

Canonical: https://digestai.news/story/starskirmish-bench-v0-2-ranks-gpt-6-astra-as-top-starcraft-bot-writer

## Summary

StarSkirmish Bench v0.2 tested how well leading AI models could write StarCraft: Brood War bots in one hour. Each model generated a Protoss bot in C++, which was then evaluated against a roster of competitive human-written bots and demo bots. The benchmark measures long-horizon reasoning and agentic coding, as models must adapt based on practice games to improve their bots.

GPT-6 Astra from OpenAI scored highest with an average win rate of 39%, surpassing GPT-6.1 Sol in second place. Gemini 4 Argon, Claude Opus 5.5, and Claude Fable 5.1 tied for third, each scoring between 37 and 39. Despite these results, the strongest human-written bots still outperform AI-generated ones significantly—GPT-6 Astra won only 7% of games against the top human bots. The benchmark also highlighted variability in model performance, with Gemini 4 Argon showing the widest range in win rates across its five runs.

## Key points

- GPT-6 Astra tops StarSkirmish Bench v0.2 with a 39% win rate against human-written bots
- Gemini 4 Argon and Claude models score 37–39%, trailing GPT-6 Astra by a clear margin
- Human-written bots still dominate: GPT-6 Astra wins only 7% of games against top human bots

## Why it matters

This benchmark reveals how far AI-generated agents lag behind human expertise in complex, long-horizon tasks like StarCraft. It also shows which models excel at agentic reasoning and coding under time constraints, guiding research priorities for AI agents.

## Sources

1. [Show HN: Gemini 4 Argon plays StarCraft](https://starskirmish.com/bench/v0-2) (starskirmish.com, 2026-10-16)

Part of the developing story: [GPT-6 Astra's Emerging Cross‑Domain Conquest](https://digestai.news/thread/stanford-and-caltech-use-gpt-6-astra-in-unitree-g1-robot-to-clean-unfamiliar) (5 stories)

## Cite

Digest AI, "StarSkirmish Bench v0.2 ranks GPT-6 Astra as top StarCraft bot writer", 16 October 2026, https://digestai.news/story/starskirmish-bench-v0-2-ranks-gpt-6-astra-as-top-starcraft-bot-writer

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/starskirmish-bench-v0-2-ranks-gpt-6-astra-as-top-starcraft-bot-writer.json