CalibratedDecisions.

Repo · Benchmarks & research

jev-column-race

Local (or hosted BYOK) race UI that labels 1,000 withheld-star app reviews in parallel columns: TypeSafe Jev typed questions versus a Gemini JSON…

Open github.com ↗

From the repository

Jev vs Gemini 3.8 Flash: labelling 1,000 app reviews, 4.1× faster and 7× cheaper

How builders describe it

Jev vs Gemini 3.8 Flash: labelling 1,000 app reviews, 4.1× faster and 7× cheaper.
Local (or hosted BYOK) race UI that labels 1,000 withheld-star app reviews in parallel columns: TypeSafe Jev typed questions versus a Gemini JSON lane, with free replay of recorded runs.
Live race rig that labels 1,000 real app reviews with Jev typed questions against Gemini JSON output on identical batches, then replays recordings and re-ranks rows locally without extra model calls.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects