CalibratedDecisions.

Repo · Benchmarks & research

Ground Zero

An alpha Python library that uses Jev to grade model responses for hallucination, correctness and instruction following, returning Noul probabilities…

Open github.com ↗

From the repository

Eval framework library to evaluate AI hallucinations, correctness, and instruction following, powered by Jev AI.

evalsevaluation-frameworkjevjev-ai

How builders describe it

An alpha Python library that uses Jev to grade model responses for hallucination, correctness and instruction following, returning Noul probabilities and five-level severity Scores.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects