CalibratedDecisions.

Post · Benchmarks & research

OpenRouter Decision Model Rankings

Spend share and token share of decision models, by task type.

Open x.com ↗
OpenRouter @OpenRouter

New: Decision Model Rankings!

See the spend share and token share of different decision models and task types, including Relevance, Correctness, Instruction Following and more.

@typesafeai is leading all categories today.

Video from the post

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects