CalibratedDecisions.

Repo · Benchmarks & research

jev-cloud-quiz

三大クラウドの機能名を、TypeSafe AI の System One モデル Jev が確率つきで判定するデモ.

Open github.com ↗

From the repository

三大クラウドの機能名を、TypeSafe AI の System One モデル Jev が確率つきで判定するデモ

awsaws-cdkjevlambda-web-adapterreacttypesafe-ai

How builders describe it

A 30-question quiz that names a feature from AWS, Azure or Google Cloud with the brand removed and asks Jev which cloud it belongs to, drawing the returned probability distribution as three bars.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects