CalibratedDecisions.

Repo · Benchmarks & research

SoulsBench

Dark Souls III realtime combat benchmark for decision models: TypeSafe Jev, OpenAI Decisions, Perplexity's decider and local Kev / Laya each fight…

Open github.com ↗

From the repository

Dark Souls benchmark for decision models

How builders describe it

Dark Souls III realtime combat benchmark for decision models: TypeSafe Jev, OpenAI Decisions, Perplexity's decider and local Kev / Laya each fight Iudex Gundyr through the same harness, state, 16 actions and 200 ms budget on the live game; the author's 50-seed results table reports wins, damage,…

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects