CalibratedDecisions.

Post · Routing & model choice

A Slack agent, twice as fast

Jev picks the skill, tool and parameters before the agent starts.

Open x.com ↗
John Yeo @johnyeo_

Jev made our Slack agent 2x faster ⚡️

Our agent can be quite slow because it needs to read skills and figure out which tools to call.

We used @typesafeai's new model to speed this up by first passing it the prompt and classifying the best skill, tool and params to use before

Video from the post

The decision Jev makes

Pick an agent, a model, a skill from a catalog, or a function and its arguments.

Where it fits

Deciding which agent, model, skill or function should handle a request. Jev is a natural router: the options are fixed and the confidence tells you when to fall back. All 348 routing & model choice projects →

Related projects