CalibratedDecisions.

Repo · Benchmarks & research

jev-shadcn-lint-eval

A small second eval for shadcn-ui/lint that uses TypeSafe's Jev to judge the linter's own output.

Open github.com ↗

How builders describe it

An eval that puts Jev two questions about shadcn-ui/lint: whether each finding is a real rule violation, and whether the linter's message tells you what to change. It runs the real linter over 131 rule test cases and scores both the detections and the messages.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects