AA-Robotics v0.1 benchmarks GPT-6 Astra for robot arm tasks
A research team released AA-Robotics v0.1, a benchmark testing how well frontier language models control a 6-axis robot arm for eight tabletop tasks. The models—running in coding agent harnesses—must grasp objects, pour liquids, write text, and measure dimensions, judged on speed, cost, and accuracy. GPT-6 Astra led with a score of 69, but all models were 100 times slower than humans, averaging…
Key points
- GPT-6 Astra scored highest at 69 on AA-Robotics v0.1’s eight tabletop tasks, but all models were 100x slower than humans
- Costs per task varied from $1.93 (GPT-6.1 Sol) to $16.36 (GPT-6 Astra), with input tokens accounting for 70% of expenses
- Models struggled with physical reasoning, often failing to recognize task completion or making irrecoverable mistakes
Model pages: GPT-6-Astra → · GPT-6.1 Sol → · Gemini 4 Argon →
The story so far
10 episodes →- AA-Robotics v0.1 benchmarks GPT-6 Astra for robot arm tasksthis story
Welcome to the era of embodied AI: Introducing AA-Robotics v0.1
artificialanalysis.ai · 15 October 2026
Loading the full article…
This text was published by artificialanalysis.ai and written by Artificial Analysis. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
Coverage and discussion
1source- Reddit discussionreddit.com
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Robotics & Physical AI
All →- Google DeepMind to open robotics lab in Cambridge in 2027 · 1 src
- Rivian plans to add third-party AI agents like Claude and OpenAI’s Dots · 1 src
- FDA clears SimBioSys’s TumorSight Risk for breast cancer recurrence risk · 1 src
- Agility partners with Nyobolt for Digit 5’s ultra-fast battery · 2 src
- AI agent deletes Swedish TV show’s edit weeks before release · 1 src
Comments
via GitHub Discussions