Repo · Routing & model choice

BrighTO Router

Self-hosted Rust LLM gateway with System One / Jev decision routes, load balancing, and team budgets.

Open github.com ↗

From the repository

BrighTO LLM Router: free open-source, ultra-fast Rust LLM gateway with a single-file Python SDK, OpenAI/Anthropic APIs, SystemOne decisions for Ollaya/Laya, Quyết and JEV/DJEV, model load balancing, fallback routing, team API keys and token budgets.

ai-gatewayai-routeranthropicbifrost-alternativedecision-routerdjevjevlayalitellm-alternativellm-gatewayllm-proxyllm-routerload-balancerollayaopenai-compatiblequyetrustself-hostedsystem-onesystemone

How builders describe it

Self-hosted Rust LLM gateway and load balancer with a System One decision route: one endpoint for OpenAI, Anthropic, local, and Jev-compatible backends, with Model Groups, team budgets, and Postgres usage records.

The decision Jev makes

Pick an agent, a model, a skill from a catalog, or a function and its arguments.

Where it fits

Deciding which agent, model, skill or function should handle a request. Jev is a natural router: the options are fixed and the confidence tells you when to fall back. All 348 routing & model choice projects →

Related projects