CalibratedDecisions.

Repo · Benchmarks & research

Decision Models Showdown

Two runnable demo apps that send identical typed questions to OpenAI Decisions (gpt-6-luna) and TypeSafe Jev (jev-latest) in parallel: a support…

Open github.com ↗

From the repository

OpenAI Decisions vs TypeSafe Jev, side by side: two demo apps where decision models answer typed questions and plain code makes the call.

How builders describe it

Two runnable demo apps that send identical typed questions to OpenAI Decisions (gpt-6-luna) and TypeSafe Jev (jev-latest) in parallel: a support ticket router over 20 labelled tickets and a cloud alert triage over 15 labelled alerts, with thresholds in plain Python making the final calls.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects