Computer use
Let AI agents use the apps on your Mac in the background, without taking your pointer. Uses your account’s Mac permissions; Esc stops them.
Every new chat can use your Mac's apps when its task needs them, in AgentSky Mac and in the Claude Code and Codex chats it runs on your Mac. Agents read an app's window through macOS Accessibility and a screenshot, so they can read a page in Chrome or a thread in Slack, then click, type and scroll in the background without moving your pointer. Verified owner requests use your Mac defaults unless explicitly limited; a bar shows while an agent works, and Esc stops it.
On your Mac
Screen Recording · Required
Agents see app windows. A bar shows while an agent is working; Esc stops it.
Accessibility · Required
Agents click, type and press keys.
Questions
- Can an AI agent use my Mac?
- Yes. With Computer use on, as it is by default, an agent in AgentSky Mac can open, read and operate the apps and browser on your Mac when its task needs them. Your own agents use your Mac defaults unless explicitly limited; Esc stops them at any moment.
- Does computer use take over my mouse and keyboard?
- No. Agents click, type and scroll inside an app's window in the background, without moving your pointer or typing over you; an app that is not running opens behind your windows. The chat and the menu bar show when an agent works.
- Can it read web pages in Chrome or messages in Slack?
- Yes. It reads an app's window through macOS Accessibility and a screenshot, which covers Chrome, Safari, Slack and most other apps, with no browser extension.
- Does it work with Claude Code and Codex?
- Yes. When AgentSky Mac runs Claude Code or Codex on your Mac, each turn gets the same tools through a local MCP server named agentsky-mac, so those chats can use your apps too.
- What permissions does it need?
- Screen Recording, so agents can see app windows, and Accessibility, so they can click and type. macOS asks for each once; turn the plugin off in Plugins at any time.