CalibratedDecisions.

Repo · Benchmarks & research

yc-jev-bench

Can Jev replace an LLM reranker?

Open github.com ↗

From the repository

Can Jev replace an LLM reranker? A benchmark of TypeSafe's Jev vs Claude Haiku and BGE on natural-language search over all 6,245 YC companies, with a live search demo.

How builders describe it

Can Jev replace an LLM reranker? A benchmark of TypeSafe's Jev vs Claude Haiku and BGE on natural-language search over all 6,245 YC companies, with a live search demo.
An independent benchmark asking whether Jev can replace an LLM reranker, run over natural-language search across all 6,245 YC companies, plus the live search app it measures: Jev routes the query, BM25 and embeddings retrieve, Jev reranks.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects