Repo · Routing & model choice

tiershift

Shift every LLM call to the cheapest model that can handle it.

Open github.com ↗

From the repository

Shift every LLM call to the cheapest model that can handle it. Routing decided by TypeSafe Jev in ~180 ms. No training data. Policy in plain YAML. TypeScript and Python.

agentscost-optimizationjevllmmodel-routingopenai-compatibleproxypythontypesafetypescript

How builders describe it

Shift every LLM call to the cheapest model that can handle it. Routing decided by TypeSafe Jev in ~180 ms. No training data. Policy in plain YAML. TypeScript and Python.

Model router that asks Jev eleven questions in one call and lets a YAML policy turn the answers into a tier. Every request starts on the fast tier and only escalates on evidence such as multi-step reasoning, hard difficulty, high stakes or safety, and every decision is logged without the message…

The decision Jev makes

Pick an agent, a model, a skill from a catalog, or a function and its arguments.

Where it fits

Deciding which agent, model, skill or function should handle a request. Jev is a natural router: the options are fixed and the confidence tells you when to fall back. All 348 routing & model choice projects →

Related projects