Study finds AI agents lack creativity needed for recursive self-improvement

The agents demonstrated strong technical execution, such as running experiments and compiling data, but struggled with hypothesis generation, backtracking from failed approaches, and integrating feedback. They often committed to unpromising methods too quickly and failed to rethink their strategies fundamentally. This gap suggests that while AI can automate the mechanical aspects of research, it cannot yet replicate the intuitive leaps necessary for transformative breakthroughs.

Anthropic co-founder Jack Clark echoed these findings, noting that current systems exhibit "rote, formulaic thinking" that hinders their effectiveness as researchers. The study implies that timelines for fully automated AI development may be overly optimistic, particularly if open-ended creativity remains a bottleneck. Future tests are underway using Anthropic’s more advanced Mythos model to see if newer architectures can bridge this creative divide.