CalibratedDecisions.

Repo · Benchmarks & research

jev-vs-pii

How good is Jev, a decision model, at finding personal information?

Open github.com ↗

From the repository

How good is Jev, a decision model, at finding personal information? Head-to-head against rules, local PII models and LLMs on three datasets: accuracy, leaks, calibration, cost and latency.

anonymizationbenchmarkdecision-modelllm-evaluationnlppii-detectionpresidioprivacy

How builders describe it

How good is Jev, a decision model, at finding personal information? Head-to-head against rules, local PII models and LLMs on three datasets: accuracy, leaks, calibration, cost and latency.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects