CalibratedDecisions.

Repo · Benchmarks & research

talktojev (Jev Prime)

Hosted chatbot with no language model in the loop: every word is chosen by TypeSafe Jev via the OpenRouter Decisions API (Choice over a vocabulary),…

Open github.com ↗

From the repository

Generation is Classification: a chatbot with no language model in it. Every word is chosen by a classifier. Code for the paper and the demo at talktojev.com

How builders describe it

Hosted chatbot with no language model in the loop: every word is chosen by TypeSafe Jev via the OpenRouter Decisions API (Choice over a vocabulary), with confidence-driven lookahead and self-critique.
A chatbot with no language model: every word is picked from roughly 4,700 options by Jev Choice questions, with confidence-driven lookahead, beam search across sentence directions and a self-critique loop that rewrites weak sentences. Code for the paper and the live demo at talktojev.com.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects