CalibratedDecisions.

Repo · Benchmarks & research

WaterSheep

An open, Apache-2.0 decision model with a local server that accepts Jev's /v1/systemone requests, for people who want Jev-style typed answers without…

Open github.com ↗

From the repository

A decision model that returns calibrated answers to yes/no, choice, score and multi-label questions.

browsercalibrationdecision-modelhuggingfacejavascriptjevjev-alternativelocal-firstmachine-learningmulti-label-classificationnlponnxonnxruntime-webopen-sourcepythonsystem-onetext-classificationtransformerswebassemblyzero-shot-classification

How builders describe it

Open, Apache-2.0 alternative to Jev that runs locally. Its server accepts Jev's /v1/systemone requests, so TypeSafe's Python SDK works against it, and it adds multi-label questions.
An open, Apache-2.0 decision model with a local server that accepts Jev's /v1/systemone requests, for people who want Jev-style typed answers without sending text to a hosted API.
Apache-2.0 ModernBERT fine-tune that answers noul, choice, score and multi-label questions with a probability for every option. It serves Jev's POST /v1/systemone locally so TypeSafe's Python SDK runs unchanged, reporting 0.026 expected calibration error on its test split.

The decision Jev makes

Benchmark questions with known answers, to check accuracy and confidence.

Where it fits

Head-to-head tests, calibration studies and independent research into how well Jev decides, how fast, and at what cost. All 682 benchmarks & research projects →

Related projects