CalibratedDecisions.

Post · Safety & guardrails

Jev as an agent safety monitor

Checks each agent action first: most attacks caught, almost no false blocks.

Open x.com ↗
😎Nick 常胜 @isNickMa

Tested TypeSafe’s Jev (no-text, probability-only model) as an AI agent safety monitor.

Checking each action first worked well caught most attacks with almost no false blocks, and much faster than Gemini.

Image from the post

How builders describe it

Test report using Jev to check each agent action first: most attacks caught, almost no false blocks.
A test report that puts Jev in front of each agent action before it runs: most attacks were caught, with almost no false positives on legitimate tool calls.

The decision Jev makes

Allow, flag or escalate a message, tool call or action.

Where it fits

Screening messages, tool calls and outputs before they cause trouble. Jev gives a fast, calibrated verdict that can sit in front of every request or agent action. All 229 safety & guardrails projects →

Related projects