CalibratedDecisions.

Repo · Benchmarks & research

Routing Experiment

Evaluate Jev as a model-selection layer.

Open github.com ↗

From the repository

Benchmarking TypeSafe's Jev decision model as a cost-efficient LLM router on RouterArena

How builders describe it

Benchmarking TypeSafe's Jev decision model as a cost-efficient LLM router on RouterArena.
Runs Jev as an LLM router over two public benchmarks, with a no-Jev ablation and RouterArena's own scorer so the numbers sit next to the public leaderboard.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects