CalibratedDecisions.

Repo · Benchmarks & research

system-one-security-triage

Recorded comparison of Jev, Terra, and Opus on 100 synthetic security-triage cases, five passes each, with a static inspectable dashboard.

Open github.com ↗

From the repository

Recorded comparison of Jev, Terra, and Opus on 100 synthetic security-triage cases, five passes each, with a static inspectable dashboard

ai-securitybenchmarkllm-evaluationsecuritytypesafetypescript

How builders describe it

A reproducible 100-case demo that runs TypeSafe's Jev decision model against OpenAI's Terra and Anthropic's Opus on identical synthetic security evidence, then renders the recorded JSON to a static dashboard with no credentials in the browser.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects