CalibratedDecisions.

Post · Routing & model choice

Which agent answers in a group chat

Mentions, an LLM orchestrator and Jev, compared on the same job.

Open x.com ↗
Vadim Choi @vadimchoi

$10k/month just to decide which agent should answer.

not to answer. to decide.

group chat + @mentions: fast, cheap, terrible UX.
an LLM orchestrator: nice UX, 4-7s and $0.00046 a message.

@typesafeai jev: 0.29s median, $0.00002.
same decision, $20/month.

Image from the post

The decision Jev makes

Pick an agent, a model, a skill from a catalog, or a function and its arguments.

Where it fits

Deciding which agent, model, skill or function should handle a request. Jev is a natural router: the options are fixed and the confidence tells you when to fall back. All 348 routing & model choice projects →

Related projects