CalibratedDecisions.

Repo · Benchmarks & research

2048: Jev vs Laya

Experiment where two System One decision models — hosted TypeSafe Jev and open-weight Laya (plus a LoRA fine-tune) — play 2048 on the same seeds…

Open github.com ↗

From the repository

comparing jev and layas performance and also fine-tuning laya to get maximum accuracy.

How builders describe it

Experiment where two System One decision models — hosted TypeSafe Jev and open-weight Laya (plus a LoRA fine-tune) — play 2048 on the same seeds against random and greedy baselines, each move asking a move choice and a danger yes/no from a board description, with every move logged and reports…

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects