Claude CoworkLesson 4

Computer Use Feature

Computer use extends Cowork beyond files and folders — Claude can interact with apps on your screen. Click, type, open programs, and work in the browser through Claude in Chrome, with clear rules for when connectors are safer than mouse control.

What is computer use?

Computer use lets Claude control your desktop the way you would — moving the cursor, clicking buttons, typing text, and opening applications. It is how Cowork reaches apps that do not expose a simple file or API connection.

🖱️
Click

Press buttons, select menu items, follow links

⌨️
Type

Fill forms, enter formulas, write email text

📂
Open apps

Launch Excel, a browser, mail client, or any installed program

🌐
Navigate browsers

Go to URLs, scroll pages, interact with web UIs

Computer use — desktop control
Excel
Chrome
Mail
Finder
Active window — spreadsheet open
Claude actions
📊ExcelClick cell B4, type formula
📁FinderOpen Documents folder← cursor here
🌐ChromeNavigate to vendor portal
✉️MailType subject line and send
Computer use lets Claude click, type, and open apps — the same actions you would do by hand
Example prompt: "Open Excel, go to the Expenses tab, sum column C, then open Mail and draft a message with the total." Cowork uses computer use to switch apps and complete each step.

Claude in Chrome as a connector

Claude in Chrome is a browser extension that connects Claude to the page you are viewing. For web-based tasks, it is often faster than computer use — Claude reads and acts inside Chrome so you do not need to switch windows.

→
Stays in the browser — Claude works on the current tab from a side panel — no alt-tab to Desktop.
→
Reads page content — It can see text, tables, and forms on the page you have open.
→
Browser-only tasks — Good for lookups, form fills, copying data from a portal, or summarizing a long article.
→
Install once — Add the extension from claude.com/chrome and sign in with your Claude account.
vendor-portal.example.com/orders
Order #4821 — Status
Shipped — tracking: 1Z999AA10123456784
Claude in Chrome
Copy the tracking number and add it to my spreadsheet.
Found tracking 1Z999AA10123456784 on this page. Added to row 12 in your sheet — no window switch needed.
Claude in Chrome reads the page you are on and acts inside the browser — without alt-tabbing away
When to use Chrome vs full computer use: If the task is entirely on a website, start with Claude in Chrome. If you need a desktop app (Excel, PDF tool, legacy CRM), use computer use in Cowork.

Safety model: connectors vs. mouse

Not every action needs the mouse. Anthropic separates connectors (structured integrations) from computer use (screen control). Connectors are narrower and easier to review; mouse control handles actions outside those integrations.

Connectors (API / integration)

Claude talks to an app through a built-in connection — structured data in and out. No screen control.

Examples:
  • Claude in Chrome reading the current tab
  • Plugin pulling data from an API
  • Web search fetching live pages
✓ Narrower scope · ✓ No mouse · ✓ Easier to review
Computer use (mouse & keyboard)

Claude moves the cursor, clicks buttons, and types keystrokes — the same as a person at the desk.

Examples:
  • Clicking through a desktop app with no API
  • Filling a form in legacy software
  • Opening apps and navigating menus
⚠ Broader reach · Use "Ask before acting" · Review each step
Prefer connectors when available; computer use is for apps that have no direct integration
QuestionUse a connectorUse computer use
Task is on a website you already have openClaude in ChromeOnly if Chrome cannot reach it
App has a plugin or API integrationConnector / pluginSkip mouse if integration exists
Legacy desktop app with no APINot availableComputer use
Need to click through OS menusNot availableComputer use
Sensitive action (send email, delete file)Prefer connector + confirmAsk before acting on each step
Safe defaults: Keep "Ask before acting" on when computer use is enabled. Review what Claude will click or type before approving. Prefer Claude in Chrome for web work so Claude stays inside one app.

Simple examples

Computer use

"Open the PDF app, export page 3 as PNG, and save it to my Reports folder."

Mouse + keyboard on desktop
Claude in Chrome

"On this order page, copy the delivery date and add it to my tracking sheet."

Chrome connector — no window switch
Connector (plugin)

"Pull last week's Slack summary via the installed plugin."

API connector — no screen control
Summary:
  • Computer use — Claude clicks, types, opens apps, and navigates browsers on your desktop.
  • Claude in Chrome — browser connector for web tasks without switching windows.
  • Safety: prefer connectors when they exist; use mouse control for legacy apps, with step approval.

What's Next

Projects Feature — organize files, instructions, and task context in one Cowork workspace.