The Defence AI Centre (DAIC) has announced the launch of the AI Model Arena, a new platform designed to redefine how the Ministry of Defence evaluates and procures AI technologies.

Developed in partnership with UK-based AI firm Advai, the tool will pilot a secure and standardised environment allowing suppliers to rapidly test and demonstrate their models against real Defence use cases.

According to DAIC, the initiative will help the MOD identify the best AI solutions by providing an objective, data-driven “demonstration by doing” mechanism for triaging technologies into the Defence Tech Scaler and other innovation pathways.

The system will also enable more dynamic supplier engagement – with the capacity to assess up to 100 models simultaneously – significantly reducing evaluation timelines while offering suppliers constructive feedback to iterate their solutions.

The AI Model Arena will communicate priority Defence use cases and initial key requirements to suppliers ahead of more detailed pre-deployment testing.

The platform itself is designed as a secure, vendor-neutral evaluation environment capable of objectively assessing AI models across four critical categories: performance, reliability, robustness, and security. Evaluations will be conducted against Defence-specific requirements, including JSP 936, with up to 100 suppliers phased through a down-selection process to ensure that only the best-in-class solutions progress.

The project builds on previous work carried out by the Royal Navy in partnership with Advai and the Accelerated Capability Environment (ACE) – a Home Office unit addressing public sector data challenges – where independent side-by-side testing of AI models from multiple suppliers was first conducted.

According to the DAIC, this supports more confident procurement decisions by mitigating risk and verifying model performance in mission-specific conditions.

The method also enables earlier identification of promising suppliers, reducing procurement bottlenecks and accelerating the pace of innovation across the Defence AI ecosystem.

Commodore Rachel Singleton, Head of the DAIC, said the new platform would be central to responsible, fast-paced AI adoption: “This initiative is central to our ambition to adopt AI responsibly and at pace, ensuring we maintain a strategic advantage in an increasingly competitive landscape.

“I encourage all AI suppliers to engage with the AI Model Arena. This is your opportunity to showcase your capabilities, drive innovation, and help shape the future of Defence AI.”

Recommended reading

• UK Business Incorporations Up Despite Drop in Equity Investment
• Scots Tech Incorporations Drop 9% Year-on-year, But Beat UK Average
• Scotland Bucks Trend of Slowing UK Tech Incorporations

According to DAIC, the pilot offers a scalable solution to some of the MOD’s core procurement challenges, helping improve performance, boost confidence, and deliver cutting-edge AI capabilities to frontline personnel in significantly shorter timeframes.

The initiative aligns with Action 43 of the MOD’s AI Opportunities Plan (2025), which calls for automated evaluation of AI models against Defence benchmarks. The hope is that the AI Model Arena will deliver the same level of insight as traditional review methods but in a fraction of the time.

“By streamlining how we evaluate and procure AI technologies, the AI Model Arena will help to reduce barriers to innovation, strengthen our defence industrial partnerships, and ensure our warfighters have access to the most advanced AI solutions to operate, deter, fight and win,” the organisation said.