Repo · Routing & model choice

typed-lm

Rust (Candle) framework that turns dense decoder models into a typed semantic-routing API—Choice, Noul, Score in a single forward pass—with…

Open github.com ↗

From the repository

Single-forward-pass semantic routing in Rust: turn dense LLMs (Llama, Qwen, Mistral, Gemma) into a typed decision API with LoRA/QLoRA training and FP8/FP4 quantization, built on Candle.

actix-webcandleclassificationhuggingfaceinferencellmloramachine-learningmlopsnlpqloraquantizationrustsemantic-routingtransformer

How builders describe it

Rust (Candle) framework that turns dense decoder models into a typed semantic-routing API—Choice, Noul, Score in a single forward pass—with LoRA/QLoRA training and a System One–shaped HTTP server.

The decision Jev makes

Pick an agent, a model, a skill from a catalog, or a function and its arguments.

Where it fits

Deciding which agent, model, skill or function should handle a request. Jev is a natural router: the options are fixed and the confidence tells you when to fall back. All 348 routing & model choice projects →

Related projects