CalibratedDecisions.

Repo · Benchmarks & research

WorkflowEvals

Official TypeSafe reproducibility harness for evals.typesafe.ai workflow benchmarks (invoice, customer service, agent traces, security incidents).

Open github.com ↗

From the repository

evals.typesafe.ai workflow code published

How builders describe it

Evals.typesafe.ai workflow code published.
The code behind evals.typesafe.ai. It runs four published workflows against Jev and other providers and scores them on reference labels.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects