CalibratedDecisions.

Repo · Benchmarks & research

open-alternative-jev

Typed, calibrated decisions from any open-weights model, on your own GPU.

Open github.com ↗

How builders describe it

Open alternative to Jev: typed, calibrated decisions from any open-weights LLM in one forward pass (HF + vLLM), with benchmarks.
A Python research library that extracts typed choices and probability distributions from open-weight language models, comparing packed questions with separate inference and optional calibration.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 332 benchmarks & research projects →

Related projects