CalibratedDecisions.

Repo · Benchmarks & research

jevgpt

A chatbot built on a model that cannot generate text (TypeSafe AI's Jev, driven autoregressively).

Open github.com ↗

From the repository

A chatbot built on a model that cannot generate text (TypeSafe AI's Jev, driven autoregressively)

autoregressivejokellmremotiontypesafe

How builders describe it

Chat client over jev-latest, which cannot generate text: the transcript becomes the state and each step is a choice over a 20,000-word dictionary, so replies are built one word at a time.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects