CalibratedDecisions.

Repo · Benchmarks & research

jev (taifoon-io)

Grade an AI agent job with TypeSafe Jev: fact checks in code, four closed questions, receipt with probabilities, optional on-chain records…

Open github.com ↗

From the repository

Grade an AI agent's job with TypeSafe's Jev: did it do the work as the task laid it out? Facts first, Jev on your own key, a receipt, and optional on-chain records.

agent-evaluationagentic-commerceai-agentsbaseerc-8183graderjevllm-as-a-judgetypesafe

How builders describe it

Grade an AI agent job with TypeSafe Jev: fact checks in code, four closed questions, receipt with probabilities, optional on-chain records (@taifoon/jev)

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects