CalibratedDecisions.

Repo · Benchmarks & research

Claims, Choices and Labels (jev-eval)

Audit of Jev (jev-1.13.0) and five generative models on how they handle claims, forced choices and labels about Taiwan's status in several languages,…

Open github.com ↗

From the repository

Audit of TypeSafe Jev and five generative models (Claude, Grok, GPT-6) on Taiwan's sovereignty in Traditional Chinese, Simplified Chinese and English

ai-auditllm-evaluationmultilingualpolitical-biastaiwan

How builders describe it

Audit of Jev (jev-1.13.0) and five generative models on how they handle claims, forced choices and labels about Taiwan's status in several languages, with a draft preprint, item explorer and replays.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects