CalibratedDecisions.

Repo · Benchmarks & research

ruby_llm-providers-typesafe

TypeSafe System One models (Jev) for RubyLLM: typed judgments, evaluations and reranking.

Open github.com ↗

How builders describe it

RubyLLM provider that turns typed questions — noul, choice and score — into calibrated answers with probabilities, confidence and per-call cost, and adds reranking through RubyLLM.rerank.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects