{"version":1,"type":"story","url":"https://digestai.news/story/starskirmish-bench-v0-2-ranks-gpt-6-astra-as-top-starcraft-bot-writer","json":"https://digestai.news/story/starskirmish-bench-v0-2-ranks-gpt-6-astra-as-top-starcraft-bot-writer.json","markdown":"https://digestai.news/story/starskirmish-bench-v0-2-ranks-gpt-6-astra-as-top-starcraft-bot-writer.md","slug":"starskirmish-bench-v0-2-ranks-gpt-6-astra-as-top-starcraft-bot-writer","headline":"StarSkirmish Bench v0.2 ranks GPT-6 Astra as top StarCraft bot writer","summary":"StarSkirmish Bench v0.2 tested how well leading AI models could write StarCraft: Brood War bots in one hour. Each model generated a Protoss bot in C++, which was then evaluated against a roster of competitive human-written bots and demo bots. The benchmark measures long-horizon reasoning and agentic coding, as models must adapt based on practice games to improve their bots.\n\nGPT-6 Astra from OpenAI scored highest with an average win rate of 39%, surpassing GPT-6.1 Sol in second place. Gemini 4 Argon, Claude Opus 5.5, and Claude Fable 5.1 tied for third, each scoring between 37 and 39. Despite these results, the strongest human-written bots still outperform AI-generated ones significantly—GPT-6 Astra won only 7% of games against the top human bots. The benchmark also highlighted variability in model performance, with Gemini 4 Argon showing the widest range in win rates across its five runs.","keyPoints":["GPT-6 Astra tops StarSkirmish Bench v0.2 with a 39% win rate against human-written bots","Gemini 4 Argon and Claude models score 37–39%, trailing GPT-6 Astra by a clear margin","Human-written bots still dominate: GPT-6 Astra wins only 7% of games against top human bots"],"whyItMatters":"This benchmark reveals how far AI-generated agents lag behind human expertise in complex, long-horizon tasks like StarCraft. It also shows which models excel at agentic reasoning and coding under time constraints, guiding research priorities for AI agents.","category":{"slug":"research","name":"Research","url":"https://digestai.news/category/research"},"entities":{"companies":["OpenAI","Anthropic","Google","Meta"],"models":["GPT-6 Astra","GPT-6.1 Sol","Gemini 4 Argon","Claude Opus 5.5","Claude Fable 5.1","Muse Wonder Full"],"people":[]},"firstPublishedAt":"2026-10-16T14:18:44Z","updatedAt":"2026-10-16T14:18:44Z","sourceCount":1,"hasPrimarySource":false,"sources":[{"outlet":"starskirmish.com","title":"Show HN: Gemini 4 Argon plays StarCraft","url":"https://starskirmish.com/bench/v0-2","publishedAt":"2026-10-16T14:18:44Z","type":"press","primary":false,"lead":true}],"sourceNotes":null,"discussions":[{"site":"Hacker News","url":"https://news.ycombinator.com/item?id=50118688","points":41}],"thread":{"title":"GPT-6 Astra's Emerging Cross‑Domain Conquest","url":"https://digestai.news/thread/stanford-and-caltech-use-gpt-6-astra-in-unitree-g1-robot-to-clean-unfamiliar","storyCount":5},"cite":{"text":"Digest AI, \"StarSkirmish Bench v0.2 ranks GPT-6 Astra as top StarCraft bot writer\", 16 October 2026, https://digestai.news/story/starskirmish-bench-v0-2-ranks-gpt-6-astra-as-top-starcraft-bot-writer","publisher":"Digest AI","title":"StarSkirmish Bench v0.2 ranks GPT-6 Astra as top StarCraft bot writer","datePublished":"2026-10-16T14:18:44Z","url":"https://digestai.news/story/starskirmish-bench-v0-2-ranks-gpt-6-astra-as-top-starcraft-bot-writer"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}