{"version":1,"type":"story","url":"https://digestai.news/story/aa-robotics-v0-1-benchmarks-gpt-6-astra-for-robot-arm-tasks","json":"https://digestai.news/story/aa-robotics-v0-1-benchmarks-gpt-6-astra-for-robot-arm-tasks.json","markdown":"https://digestai.news/story/aa-robotics-v0-1-benchmarks-gpt-6-astra-for-robot-arm-tasks.md","slug":"aa-robotics-v0-1-benchmarks-gpt-6-astra-for-robot-arm-tasks","headline":"AA-Robotics v0.1 benchmarks GPT-6 Astra for robot arm tasks","summary":"A research team released **AA-Robotics v0.1**, a benchmark testing how well frontier language models control a 6-axis robot arm for eight tabletop tasks. The models—running in coding agent harnesses—must grasp objects, pour liquids, write text, and measure dimensions, judged on speed, cost, and accuracy. **GPT-6 Astra** led with a score of 69, but all models were **100 times slower** than humans, averaging 30 minutes per task versus 20 seconds for a person. Costs ranged from **$1.93 to $16.36 per task**, with input token costs dominating expenses (70% of the total). The team notes models often over-refine attempts after passing, suggesting gaps in physical reasoning. While unsuitable for production, the authors argue tracking such progress is critical as embodied AI evolves.","keyPoints":["GPT-6 Astra scored highest at 69 on AA-Robotics v0.1’s eight tabletop tasks, but all models were 100x slower than humans","Costs per task varied from $1.93 (GPT-6.1 Sol) to $16.36 (GPT-6 Astra), with input tokens accounting for 70% of expenses","Models struggled with physical reasoning, often failing to recognize task completion or making irrecoverable mistakes"],"whyItMatters":"This benchmark highlights the gap between AI’s theoretical capabilities and real-world physical dexterity, signaling progress but also limitations. For robotics, it underscores the need for better embodied AI—critical as automation expands beyond digital tasks. The cost and speed trade-offs also raise questions about practical deployment timelines.","category":{"slug":"robotics","name":"Robotics & Physical AI","url":"https://digestai.news/category/robotics"},"entities":{"companies":["AA-Robotics"],"models":["GPT-6 Astra","GPT-6.1 Sol","Gemini 4 Argon","Claude Opus 5.5","Claude Fable 5.1"],"people":[]},"firstPublishedAt":"2026-10-15T14:46:17Z","updatedAt":"2026-10-15T14:46:17Z","sourceCount":1,"hasPrimarySource":false,"sources":[{"outlet":"artificialanalysis.ai","title":"Welcome to the era of embodied AI: Introducing AA-Robotics v0.1","url":"https://artificialanalysis.ai/articles/aa-robotics","publishedAt":"2026-10-15T14:46:17Z","type":"press","primary":false,"lead":true}],"sourceNotes":null,"discussions":[{"site":"Reddit","url":"https://www.reddit.com/r/singularity/comments/1x6nlgt/welcome_to_the_era_of_embodied_ai_introducing/","points":null}],"thread":{"title":"OpenAI's GPT-6 Expansion and Pricing Overhaul","url":"https://digestai.news/thread/comparing-openai-models-on-aws-for-workload-efficiency","storyCount":10},"cite":{"text":"Digest AI, \"AA-Robotics v0.1 benchmarks GPT-6 Astra for robot arm tasks\", 15 October 2026, https://digestai.news/story/aa-robotics-v0-1-benchmarks-gpt-6-astra-for-robot-arm-tasks","publisher":"Digest AI","title":"AA-Robotics v0.1 benchmarks GPT-6 Astra for robot arm tasks","datePublished":"2026-10-15T14:46:17Z","url":"https://digestai.news/story/aa-robotics-v0-1-benchmarks-gpt-6-astra-for-robot-arm-tasks"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}