CalibratedDecisions.

Post · Routing & model choice

Tev1 0.8B

A tiny Jev-like classifier running locally on a Mac.

Open x.com ↗
Hassan @nutlope

Just trained Tev1 0.8B, a tiny Jev-like classifier.

Here it is running completely locally on my mac with @ollama & classifying some tasks.

It's extremely fast: only ~50ms E2E latency. Video is not sped up!

Releasing weights & benchmarks very soon so you can try it yourself :)

Video from the post

The decision Jev makes

Pick an agent, a model, a skill from a catalog, or a function and its arguments.

Where it fits

Deciding which agent, model, skill or function should handle a request. Jev is a natural router: the options are fixed and the confidence tells you when to fall back. All 348 routing & model choice projects →

Related projects