Repo · Routing & model choice

jev-inference-router

Observable TypeSafe Jev decision routing with local Apple Silicon LLM inference, retrieval, and reproducible evaluations.

Open github.com ↗

From the repository

Observable TypeSafe Jev decision routing with local Apple Silicon LLM inference, retrieval, and reproducible evaluations

apple-siliconevaluationllmllm-inferencellm-routingmlopsobservabilityrag

The decision Jev makes

Pick an agent, a model, a skill from a catalog, or a function and its arguments.

Where it fits

Deciding which agent, model, skill or function should handle a request. Jev is a natural router: the options are fixed and the confidence tells you when to fall back. All 348 routing & model choice projects →

Related projects