CalibratedDecisions.

Repo · Benchmarks & research

Verdict-open-jev

An open 151M decision model on ModernBERT, with a WebGPU playground.

Open github.com ↗

From the repository

Non-autoregressive decision engine on ModernBERT (151M) with calibrated uncertainty (RLCD), TypeSafe AI Jev benchmark audit, and in-browser WebGPU playground

brier-scorecalibrationdecision-engineedge-aigliclassjevmodernbertonnxrlcdstructured-outputssystem-1typesafe-aiwebgpuzero-token-generation

How builders describe it

Non-autoregressive decision engine on ModernBERT (151M) with calibrated uncertainty (RLCD), TypeSafe AI Jev benchmark audit, and in-browser WebGPU playground.
An encoder-side reproduction of Jev built on a retrained GLiClass ModernBERT base (151M): it evaluates multiple typed questions in one non-autoregressive forward pass, returning choices, ordinal scores, and probabilities under 35 ms.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects