CalibratedDecisions.

Article · Benchmarks & research

Auto-optimizing Jev: Half the Errors, 1/7 the Cost

Kiln points its autoresearch loop at Jev for Mandarin pinyin disambiguation.

Open kiln.tech ↗

How builders describe it

Kiln points its autoresearch loop at Jev for Mandarin pinyin disambiguation. The optimized harness, built from jieba segmentation and CC-CEDICT word evidence with some chained Jev calls, cuts mistakes from 316 to 147 on 61,750 decision positions, ahead of a DeepSeek reasoning baseline at $1.60…

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects