CalibratedDecisions.

Post · Agents & browsers

A computer assistant that listens

Local Whisper hears everything; Jev decides which action to take, in real time.

Open x.com ↗
Marc Köhlbrugge @marckohlbrugge

building a computer assistant with Jev

local whisper listens to everything I say which then gets classified by Jev to determine what actions to take

it uses a small Swift app to provide the full accessibility tree to Jev (i.e. tell its what's on my screen, what can be clicked,

Image from the post

The decision Jev makes

Pick the next click, field or navigation from the legal actions on screen.

Where it fits

Browser agents need to choose an action on every step. With Jev each step is a choice from the actions actually available on the page, which keeps agents fast and on the rails. All 299 agents & browsers projects →

Related projects