CalibratedDecisions.

Post · Benchmarks & research

Jev against Claude Haiku 5.5 on 262 real decisions

Jev got 204 right and Haiku 5.5 got 177.

Open x.com ↗
Stanislav Sorokin @stas_sorokin_

Jev raised $870M at $7.5B yesterday. On 262 of our real decisions it beat Claude Haiku 5.5, 204 to 177.

TypeSafe's decision model got that valuation weeks after launch, in the same week Anthropic shipped Haiku 5.5 at $0.10 per million input tokens. So we checked whether a cheap

Video from the post

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects