Repo · Benchmarks & research
open-alternative-jev
Typed, calibrated decisions from any open-weights model, on your own GPU.
Open github.com ↗How builders describe it
Open alternative to Jev: typed, calibrated decisions from any open-weights LLM in one forward pass (HF + vLLM), with benchmarks.
A Python research library that extracts typed choices and probability distributions from open-weight language models, comparing packed questions with separate inference and optional calibration.
The decision Jev makes
Benchmark questions with known answers, to check accuracy and confidence.
Where it fits
Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 332 benchmarks & research projects →