CalibratedDecisions.

Repo · Benchmarks & research

padflow-jev-evals

Typed-decision benchmark from PadFlow (land development SaaS): schemas, anonymized labeled rows, and a runner for confidence-calibrated models like…

Open github.com ↗

From the repository

Typed-decision benchmark from PadFlow (land development SaaS): schemas, anonymized labeled rows, and a runner for confidence-calibrated models like TypeSafe Jev.

How builders describe it

Typed-decision benchmark from PadFlow (land development SaaS): schemas, anonymized labeled rows, and a runner for confidence-calibrated models like TypeSafe Jev.
A public benchmark for the three typed decisions a land-development SaaS actually makes: JSON schemas, anonymized seed rows, and a script that scores any OpenAI-compatible model on accuracy, calibration, cost and latency.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects