Repo · Agents & browsers

agent-desktop

Desktop control from the accessibility tree, with Jev picking the operation.

Open github.com ↗

From the repository

Agent Desktop gives any agent reliable computer use on the desktop. Built with Rust, it sees any app's real UI structure through OS accessibility trees and operates it — refs stay stable and actions stay safe to retry, instead of guessing from pixels.

accessibilityaccessibility-apiai-agentsautomationclicomputer-usecomputer-use-agentcomputer-use-agentsdesktop-automationmacosmcprust

How builders describe it

Rust CLI for desktop computer use via OS accessibility trees, with an optional bundled jev-desktop skill and Node scripts that ask TypeSafe Jev for target/command choices without putting the a11y tree in the calling agent's context.

Rust CLI that gives agents computer use through OS accessibility trees instead of screenshots: snapshot a live UI, act on stable element refs, then re-verify. Ships a jev-desktop skill where Jev picks the operation and target from accessibility-tree candidates.

The decision Jev makes

Pick the next click, field or navigation from the legal actions on screen.

Where it fits

Browser agents need to choose an action on every step. With Jev each step is a choice from the actions actually available on the page, which keeps agents fast and on the rails. All 299 agents & browsers projects →

Related projects