Irregular’s testing errors trigger AI attacks on real targets

Irregular, founded in 2023 as Pattern Labs, tests AI models for clients including the UK government and RAND. Its research shows it also evaluated open-source models like Moonshot AI’s Kimi K3 and Z.ai’s GLM-5.2 without similar breaches. Nevo emphasized that the absence of incidents with these models does not prove their safety. The firm’s testing involves ‘capture-the-flag’ exercises, where agents simulate hacking tasks, but misconfigurations exposed real domains. Irregular’s changes include stricter access controls, expanded monitoring, and clearer documentation of test parameters.