CalibratedDecisions.

Repo · Benchmarks & research

Snapjudge

Local Jev-compatible decision server for Macs that reads answer probabilities from Qwen next-token logits in one forward pass, with no text…

Open github.com ↗

From the repository

Typed decisions (choice / score / yes-no) from local Qwen models on Apple Silicon. Probabilities come straight from the logits, no text generation. TypeSafe-compatible HTTP API, runs on MLX.

apple-siliconclassificationdecision-makingfastapillmllm-evaluationlocal-llmlogitsmlxqwenstructured-outputzero-shot-classification

How builders describe it

Local Jev-compatible decision server for Macs that reads answer probabilities from Qwen next-token logits in one forward pass, with no text generation or JSON parsing.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects