Repo · Routing & model choice
LiteLLM
LiteLLM's proxy adds TypeSafe guardrail hooks and a Jev complexity classifier for policy judgments and request routing across 100+ model providers.
Open github.com ↗From the repository
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenaiopenai-proxyrustrust-aivertex-ai
The decision Jev makes
Pick an agent, a model, a skill from a catalog, or a function and its arguments.
Where it fits
Deciding which agent, model, skill or function should handle a request. Jev is a natural router: the options are fixed and the confidence tells you when to fall back. All 348 routing & model choice projects →