CalibratedDecisions.

Repo · Benchmarks & research

jev-search-rerank-eval

Does a TypeSafe Jev rerank beat embedding search?

Open github.com ↗

How builders describe it

Does a TypeSafe Jev rerank beat embedding search? Graded relevance eval (9,831 pairs, 164 zh/en queries) over the Agent Skills Hub catalog, with the judge-circularity bias measured.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 332 benchmarks & research projects →

Related projects