CalibratedDecisions.

Repo · Benchmarks & research

Spam Eval

Test spam detection against simpler baselines.

Open github.com ↗

From the repository

Zero-shot spam filtering with TypeSafe Jev Noul questions, compared with TF-IDF baselines

How builders describe it

Zero-shot spam filtering with TypeSafe Jev Noul questions, compared with TF-IDF baselines.
An exploratory study of zero-shot ham, spam, and phishing classification with Jev: enriched email context raised main-set accuracy from 93.62% to 98.64%, within 0.23 points of a trained TF-IDF baseline.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects