Repo · SDKs & integrations

pytest-jev

Pytest plugin for semantic assertions: ask whether text holds or lacks plain-language claims (plus choice/score helpers), judged by TypeSafe Jev…

Open github.com ↗

From the repository

Pytest plugin for semantic assertions on LLM output using Jev's calibrated probabilities.

jevllmllm-evaluationpytestpytest-pluginpythontestingtypesafe

How builders describe it

Semantic assertions for pytest: test what your LLM app's output means, judged by TypeSafe's Jev.

Pytest plugin for semantic assertions: ask whether text holds or lacks plain-language claims (plus choice/score helpers), judged by TypeSafe Jev instead of exact string matches.

A pytest plugin for semantic assertions: jev.expect sends many holds and lacks claims about one text to Jev in a single request and fails visibly when a probability is uncertain.

The decision Jev makes

Any Jev question: yes or no, a choice, or a score, from your own stack.

Where it fits

Official and community SDKs, MCP servers and integrations for calling Jev from the languages and tools you already use. All 625 sdks & integrations projects →

Related projects