CalibratedDecisions.

Repo · Benchmarks & research

jev-frontier-bench

Reproducible benchmark of TypeSafe Jev 1.13 against frontier LLMs on 200 typed decisions with accuracy, calibration, human-agreement, latency, and…

Open github.com ↗

From the repository

TypeSafe Jev 1.13 vs Claude Fable 5.1, GPT-6 Astra, Kimi K3, MiniMax M3 and DeepSeek V4.1 Flash on 200 typed decisions: accuracy, calibration, agreement with 100 human annotators, latency and cost

How builders describe it

Reproducible benchmark of TypeSafe Jev 1.13 against frontier LLMs on 200 typed decisions with accuracy, calibration, human-agreement, latency, and cost.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects