Repo · Safety & guardrails
jevcal
Choose acceptance thresholds from labeled examples.
Open github.com ↗From the repository
Stop guessing confidence thresholds: calibrate, threshold, and drift-check typed decision models (TypeSafe Jev) against an LLM teacher.
calibrationconfidence-thresholdsjevllm-evalssystem-onetypesafe
How builders describe it
Stop guessing confidence thresholds: calibrate, threshold, and drift-check typed decision models (TypeSafe Jev) against an LLM teacher.
CLI that fits a per-question confidence threshold to a target accuracy on your own labeled data, verifies it on a held-out split, estimates how much traffic still needs an LLM, and re-checks locked thresholds in CI. It publishes no Jev results of its own.
The decision Jev makes
Allow, flag or escalate a message, tool call or action.
Where it fits
Screening messages, tool calls and outputs before they cause trouble. Jev gives a fast, calibrated verdict that can sit in front of every request or agent action. All 229 safety & guardrails projects →
Related projects
Safety & guardrailssnapifRust crate and CLI that scores one agent tool call against a shipped policy and returns Auto, Review or Escalate, using TypeSafe Jev…GitHub · ★ 2 · snapif
Safety & guardrailsjev-sec.github.ioJev IDS website: one flow.GitHub · ★ 2 · jev-sec
Safety & guardrailsclaudetiquetteClaude Code plugin that rewrites a hostile prompt into a plain request.GitHub · ★ 2 · zahlekhan
Safety & guardrailsdsh-backdoor-guardGuard for DeepSeek Harness: every model-requested tool call is judged by a decision model, hosted TypeSafe Jev or a self-hosted LiquidAI d1, before…GitHub · miketako3
Safety & guardrailsopencode-auto-classifierOpenCode plugin that sends each shell command, file read, and edit to TypeSafe Jev for typed classifications, then folds those answers into…GitHub · schemaitat
Safety & guardrailspi-thunder-guardSafety guard for Pi: before each bash call (and writes outside the repo) TypeSafe Jev must be at least 85% sure the call keeps to a short restriction…GitHub · Mandalorian007