Google's Gemini App for Mac Gains 'Computer Use' Feature to Automate Tasks

Image: Gemini on Mac can now use your computer · Source
Google's Gemini app on macOS can now perform multi-step tasks across local files, desktop apps, and the web with user control and live previews, streamlining workflows and automating repetitive chores.
Google has enhanced its Gemini app for macOS with a new ‘computer use’ capability, allowing the AI to assist users in completing complex, multi-step tasks across local files, desktop applications, and web services. This functionality enables users to delegate repetitive workflows such as filling forms, preparing presentations, or listing items for sale on resale platforms by merely describing the desired operations.
The Gemini app operates in an isolated background window visible within the chat interface, providing a live preview of its activity. This design ensures that users can continue using their computer without screen interruptions or cursor conflicts. Importantly, users retain full control over the process by selecting which applications Gemini is permitted to access, monitoring each step as it unfolds, and approving critical actions before execution.
Google emphasizes privacy and security in this new feature, allowing users to pause the automation at any point and maintain oversight of app permissions. Examples of tasks Gemini can assist with include batch color-grading photos in design software, extracting information from PDFs to complete shipping quote forms, compiling data from dashboards for presentations in Google Slides, and managing bulk listings on resale platforms by analyzing photos and pricing.
This feature rollout begins in the United States for English-speaking users and is available by downloading the Gemini app for Mac from the official site. The timing coincides with Apple’s plans to introduce stricter controls over full disk access for Mac apps in macOS 27.3, aiming to mitigate potential risks linked with AI agents that automate computer use.
Google’s implementation offers a practical advancement in AI-powered productivity by blending autonomous task execution with user oversight, reflecting growing trust in AI assistance for professional and creative workflows. Users eager to explore AI-driven automation in their daily Mac usage can adopt Gemini's new capabilities immediately following installation.



Sources and original reporting
Read the original source ↗

Comments (0)
No comments yet. Start the discussion.
Write a comment
Comments are published after moderation. Your name and comment will be visible publicly. Account