Evaluations

Make progress measurable.

Open benchmarks that reveal where models fall short, and where improvement begins.

A brass precision probe examines a small illuminated flaw in a green circuit board on a limestone plinth.

Cybersecurity

SecProbe

Adaptive evaluation of coding agents on repository-scale vulnerability repair, selecting or generating tasks to reveal capability gaps.

An open book unfolds into three miniature architectural scenes, joined by an amber thread.

Interactive narrative

NARRA-Gym

An executable evaluation environment for agents that sustain interactive stories, adapt to users, and manage narrative state across multiple turns.