CalibratedDecisions.

App · Benchmarks & research

yuwakisa.com

I have a benchmark that tests models for "here's a set of statements, express the common principle behind them" and the model expresses a principle.

Open yuwakisa.com ↗

How builders describe it

I have a benchmark that tests models for "here's a set of statements, express the common principle behind them" and the model expresses a principle. Then in fresh context windows, the model is shown a series of statements and asks "which of these statements are examples of the principle?" jev…

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 332 benchmarks & research projects →

Related projects