CalibratedDecisions.

Post · Routing & model choice

On-device audio, no LLM in the loop

Jev makes about 20 decisions in one call and picks which local model runs.

Open x.com ↗
Desert Ant Labs @desertantlabs

Jev + on-device models = results in seconds with no LLM in the loop.

Quick demo app to show the possibilities. Drop in an audio file: Ear detects the language, Voz transcribes it and Redact removes PII.

Then @typesafeai's Jev makes about 20 decisions in one call in

Video from the post

The decision Jev makes

Pick an agent, a model, a skill from a catalog, or a function and its arguments.

Where it fits

Deciding which agent, model, skill or function should handle a request. Jev is a natural router: the options are fixed and the confidence tells you when to fall back. All 348 routing & model choice projects →

Related projects