CalibratedDecisions.

Repo · Benchmarks & research

metask-jev

Calibrated typed-decision models, one forward pass each.

Open github.com ↗

From the repository

Metask-Jev: calibrated typed-decision models (Jev-class). Single forward pass, candidate-logit readout. metask-jev-4b beats Bespoke Nimble-9B and Jev on JevBench.

How builders describe it

Metask-Jev: calibrated typed-decision models (Jev-class). Single forward pass, candidate-logit readout. metask-jev-4b beats Bespoke Nimble-9B and Jev on JevBench.
An open-weight Jev-class lab: a candidate-logit scorer that turns state plus a bounded rubric into calibrated probabilities per option in a single forward pass, with no generation and no parsing.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects