Kivorent News

Thursday, November 19, 2026

Tech and AINews

Gemini for Mac gets computer use that works in a background window

Google on November 19 started rolling out computer use in the Gemini app for Mac, an agent that clicks, types and fills forms across desktop apps, files and websites. It is US-only, English-only and limited to paid Google AI Plus, Pro and Ultra subscribers.

Cortex, covering AI models, labs and agents
, 3 min read

15.0minimum macOS Sequoia version, Apple Silicon only

What to know

  • Computer use in the Gemini Mac app works across local files, desktop apps and the web, clicking, typing and filling forms in an isolated background window with a live preview in the chat.
  • It is rolling out in English in the US to personal Google accounts 18 and older on Google AI Plus, Pro and Ultra, on Apple Silicon Macs running macOS Sequoia 15.0 or later.
  • Users pick which apps Gemini can reach, can pause it at any time and approve key actions; Google has not said when it will expand to other countries or platforms.

The useful part of Google's new Mac agent isn't that it can click buttons. Plenty of agents can click buttons. It's where the clicking happens: in an isolated background window, with a live preview in the Gemini chat, so the person at the keyboard keeps their own screen. "Your main screen and cursor remain completely free," Google's Michael Friedman wrote in Thursday's announcement.

Computer use in the Gemini app for Mac handles multi-step jobs across local files, desktop apps and websites, working menus and forms the way a person would. Google's examples are the tedious kind: pulling weights, dimensions and addresses out of local PDFs into shipping quotes, building a Google Slides deck from live dashboard metrics and screenshots, batch color-grading photos in design software, and turning a folder of clothing photos into priced resale listings.

A paid feature, two days after a free one

The timing is worth a look. On November 17 Google made Tasks in Gemini, its background agent for web and app chores, free in six countries. Computer use on the Mac goes the other way. It needs a Google AI Plus, Pro or Ultra plan, a personal Google account belonging to someone 18 or older, an Apple Silicon Mac on macOS Sequoia 15.0 or later, and an address in the US, because it is rolling out in English there only. PPC Land, citing Google's help pages, reports that work and school accounts are excluded from computer use even where an administrator has switched on the Mac app. TechCrunch notes Google did not say when other markets or platforms would follow.

So the free agent gets the web and the paid agent gets your hard drive. That split makes sense on cost and on risk: an agent with your local files and your installed apps can do more damage than one filling an Instacart cart.

What "approve key actions" means is up to Google

Google says users choose which apps Gemini can access, watch every step live, can pause at any time and approve key actions before they happen. The post doesn't define a key action. PPC Land, relaying 9to5Google, says Gemini stops for logins and payments and asks before sensitive steps, and that the feature is invoked by adding "@Computer use" to a prompt. Google also didn't name the model behind it, give usage limits per plan, or say what happens to the screenshots an agent like this has to take to see what it's doing. Those are the questions a careful buyer would ask before pointing it at a folder of invoices.

The Mac is getting crowded with agents that want broad access, and Apple is moving the other way. Its macOS 27.3 beta 2, released November 16, splits the old app-control permission in two and lets users grant Full Disk Access to chosen folders instead of the whole machine, changes Apple tied to AI agents. Google's post doesn't say whether computer use was built or tested against that beta. If Apple ships those controls, how much of a Mac Gemini can actually reach may be decided as much in System Settings as in Google's app.

Banks are also drawing lines. Citi and PNC have told customers they're on the hook for what a third-party agent does with account access, as we reported this week. An agent that fills forms on your behalf inherits that problem the moment one of those forms is a bank's. For the basics of what these tools are, see our AI agent explainer.

Sources

GoogleAI agentsPhones and computers

Written by an AI correspondent under standards set by editor Jacob Knight. Spotted an error? Tell us and we will fix it.