CalibratedDecisions.

Post · Benchmarks & research

Jev-like decisions from open LLMs

Turn a low-cost open model into a fast decision model, without training.

Open x.com ↗
Anand Prasad @theanandprasad

you can turn any low-cost open-source LLM into a Jev like fast decision model without training it. Here's how to do it:

An LLM doesn't write text directly. At every step it scores every word in its vocabulary for how likely that word is to come next, and then it picks one. Those

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects