Computing

Google Enhances Gemini AI for Automating Complex Mac Workflows

Tendela Briefing ·
7 views · 0 Comments
"Gemini supports interleaved sequences of text, image, audio, and video as inputs (illustrated by tokens of different colors in the input sequence). It can output responses with interleaved image
and text."

Image: Illustrative image · Authors of the preprint: Gemini Team Google: Rohan Anil, Sebastian Borgeaud, Yonghui Wu, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, et al. · CC BY 4.0 · Source

Google has introduced a new feature in its Gemini AI that automates repetitive tasks on Mac computers, surpassing basic voice assistants like Siri. The tool performs clicks, typing, and menu navigation in the background, helping users streamline workflow.

Google recently announced an upgrade to its Gemini AI software, adding the ability to automate complex and repetitive workflows on Mac computers. Unlike Apple’s Siri, which primarily responds to voice commands, Gemini can autonomously perform tasks that involve multiple clicks, typing, form filling, and menu navigation. Users simply describe the task they want to automate, and Gemini executes it behind the scenes.

This new functionality runs in an isolated background window with a live preview presented in the chat interface, allowing users to continue using their Mac without interruption to the screen or cursor. Users have control over which applications Gemini can access and can watch or pause each action step. For critical operations, the system requires user approval before proceeding.

Google highlighted several specific use cases illustrating Gemini’s practical applications. The AI can handle creative workflows like batch color-grading photos or setting up 3D scenes. It can also process logistical tasks such as filling out multi-box shipping quotes by extracting data from local PDFs. Furthermore, Gemini can assemble Google Slides presentations using live metrics from dashboards and screenshots, and assist in resale listings by analyzing product photos and researching current prices.

This feature is currently available to users in the United States who subscribe to Google AI Plus, Pro, or Ultra plans and use the Gemini app on Apple Silicon Macs running macOS Sequoia 15.0 or later. By enabling such sophisticated automation capabilities on Macs, Google aims to exceed the limitations of traditional voice assistants and boost user productivity through advanced AI interaction.

This development represents a significant step forward in software automation on macOS, combining natural language task description with robust AI-driven execution in a way that respects user control and transparency. It reflects Google's ongoing efforts to integrate artificial intelligence closely with everyday workflows in personal computing environments.

Sources and original reporting

Source: Mobile World Live
Read the original source ↗

Comments (0)

No comments yet. Start the discussion.

Write a comment

Comments are published after moderation. Your name and comment will be visible publicly. Account