CalibratedDecisions.

Post · SDKs & integrations

Open Jev-Compatible API (SGLang)

An independent Jev-compatible public API backed by Qwen3.6-35B-A3B and SGLang radix caching, reporting 64 parallel typed-decision tasks in under a…

Open x.com ↗
Eric Zhang @ekzhang1

Inspired by @typesafeai , here is a Jev-compatible public API to play with

It runs a comparable open model (Qwen3.6-35B-A3B), and just uses SGLang radix cache to preserve the prefill reuse / really fast parallel systemone generation - 64 tasks in <1s.

github.com/ekzhang/openje…

Video from the post

How builders describe it

An independent Jev-compatible public API backed by Qwen3.6-35B-A3B and SGLang radix caching, reporting 64 parallel typed-decision tasks in under a second.

The decision Jev makes

Any Jev question: yes or no, a choice, or a score, from your own stack.

Where it fits

Official and community SDKs, MCP servers and integrations for calling Jev from the languages and tools you already use. All 340 sdks & integrations projects →

Related projects