CalibratedDecisions.

Repo · Benchmarks & research

jev-benchmarking

Code for the arXiv paper by Deußer, Sparrenberg and Sifa (arXiv:2609.37647, 2026) benchmarking TypeSafe Jev (pinned jev-1.13.0) zero-shot on 37…

Open github.com ↗

How builders describe it

Code for the arXiv paper by Deußer, Sparrenberg and Sifa (arXiv:2609.37647, 2026) benchmarking TypeSafe Jev (pinned jev-1.13.0) zero-shot on 37 public datasets against two open-weight LLMs scored on identical requests; raw responses are on Zenodo so every number can be recomputed offline.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects