CalibratedDecisions.

Repo · Benchmarks & research

openai-decisions-vs-jev-vs-laya

Independent Portuguese-language benchmark of decision models — OpenAI Decisions API (gpt-6-luna), TypeSafe Jev (jev-1.13.0) and local Laya (with…

Open github.com ↗

From the repository

Benchmark de decision models em PT-BR: OpenAI Decisions API × Jev (TypeSafe) × Laya — roteamento de agente, prompt injection e LLM-as-judge

How builders describe it

Independent Portuguese-language benchmark of decision models — OpenAI Decisions API (gpt-6-luna), TypeSafe Jev (jev-1.13.0) and local Laya (with option rotation) — on agent tool routing, prompt-injection detection and LLM-as-judge in PT-BR: 450 cases per provider (2026-10-07), with accuracy,…

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects