CalibratedDecisions.

Repo · Benchmarks & research

snbt-jev-bench

Jev on Indonesia's SNBT 2025 university entrance exam, whose papers are never released: 159 questions reconstructed from memory by volunteers, 156 of…

Open github.com ↗

From the repository

Jev on Indonesia's SNBT 2025 university entrance test: 159 questions, seven subtests, audited answer keys.

aiartificial-intelligencebenchmarkclassifierclassifier-modelembeddingsjev

How builders describe it

Jev on Indonesia's SNBT 2025 university entrance exam, whose papers are never released: 159 questions reconstructed from memory by volunteers, 156 of them scored, every response published.
Jev run against a community reconstruction of Indonesia's SNBT 2025 entrance exam: 159 remembered questions across seven subtests, 156 scored, with every request payload and response kept.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects