CalibratedDecisions.

Repo · Benchmarks & research

Jev No Enem

A public benchmark that scores Jev 1.13.0 on the Brazilian ENEM 2025 exam against open autoregressive baselines, reporting accuracy per subject area…

Open github.com ↗

From the repository

Reproducible benchmark evaluating TypeSafe AI's Jev (System One paradigm) on Brazil's ENEM 2025 standardized exam. Evaluates typed decision-making, domain-specific accuracy, and RLCD uncertainty calibration against open LLM baselines with an interactive GitHub Pages dashboard.

benchmarkbrasilenemjevllmrlcdsystem-one-models

How builders describe it

A public benchmark that scores Jev 1.13.0 on the Brazilian ENEM 2025 exam against open autoregressive baselines, reporting accuracy per subject area plus Expected Calibration Error, with a second pass that lets the model reject an item.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects