CalibratedDecisions.

Post · Benchmarks & research

OpenAI Decisions against Jev and Clef

A head-to-head video on the day OpenAI's API opened.

Open x.com ↗
vogel @ryanvogel

OpenAI just released their Decisions API so I put it head to head with Jev & Clef

and its FASTTT

Video from the post

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects