CalibratedDecisions.

Repo · Benchmarks & research

Decision-model referral on medical exams

Code, recorded runs and manuscript for a preprint (Sangzin Ahn, 2026) comparing TypeSafe Jev, OpenAI Decisions and Cloudflare Clef on 435 KorMedMCQA…

Open github.com ↗

From the repository

Referring uncertain answers by decision-model confidence on Korean and US medical licensing questions

How builders describe it

Code, recorded runs and manuscript for a preprint (Sangzin Ahn, 2026) comparing TypeSafe Jev, OpenAI Decisions and Cloudflare Clef on 435 KorMedMCQA and 1,273 MedQA questions, using each model's selected-option probability to refer its least confident 20% of answers to a stronger model versus…

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects