Gemini Live’s background mode and app extensions could blow Apple Intelligence away

New leak offers insight into the mobile AI’s features

When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.

DuringGoogle I/O 2024, the tech giant previewedGemini Live, a unique version of the AI on mobile capable of holding “natural conversations.” You can think of it like Siri, as you’ll be able to engage in a two-way dialogue withGeminiand have the AI respond concisely.

Since the initial announcement, we haven’t heard much about the tech until recently, when strings of code referencing Gemini Live were found in aGoogleapp beta. The code mentions a “background mode” letting users continue conversations “while using other apps or while [their] screen is locked.” As9To5Googlepoints out, this effectively turns the Gemini Live experience into a phone call of sorts.

The AI will continue to accept vocal inputs and reply as you do other things. A user could, for example, open Chrome on their Android phone, look up something on the search engine, and seamlessly relay that information back to Gemini. Again, the goal is to make talking with the AI natural.

9To5Google states interactions can be ended by “looking for a persistent notification” or saying “Stop” to Gemini Live aloud.

Possible features

There was more uncovered in the beta beyond the background mode, though.

Google is apparently working on a way to give users quick access to Gemini when their smartphone is locked. Looking at the report’s screenshot, you’ll be able to utilize four extensions to first-party services:Google Maps, Google Flights, Google Hotels, andYouTube.

It’s unknown exactly what you’ll be able to do with those extensions, as details are scarce. But judging from what was shown, users might be able to ask Gemini for directions, play music on YouTube, or book a flight.

Get the best Black Friday deals direct to your inbox, plus news, reviews, and more.

Sign up to be the first to know about unmissable Black Friday deals on top tech, plus get all your favorite TechRadar content.

Those four will be turned on by default, and Google seemingly has plans to add support for more extensions; however, there is a small catch. According to the screenshot, “extensions that don’t require user credentials or don’t access private data will be on by default.” Everything else would presumably require manual activation.

Additionally, users can toggle three extra features for Gemini on the lock screen, expanding the AI’s level of control. Messages lets you text friends and family, while  Workspace can locate and summarize emails or documents. Then there is Home Automation, which is arguably the most interesting as it allows homeowners to manage smart home devices from the lock screen.

Surpassing Apple

It’s unknown when Gemini Live will launch. The May announcement said the software was supposed to arrive within the coming months toGemini Advancedsubscribers. So far, Google has been silent. Maybe we’ll see it before summer ends or later in the fall.

Whenever it is released, the background mode and lock screen interactivity could allow the upgrade to stand out against the likes ofApple Intelligence.Apple’s tech is highly capable, too, offering all sorts of tools for organization, content creation, and more. However, judging from what we’ve seen, constant interaction is required. Gemini Live is less stringent, which could make it easier to use.

As always, take these leaks with a grain of salt. Things can always change last minute.

If you’re interested in what is the best AIchatbotout there, check out ourVersus articlewhere we compare the big three: Meta AI, ChatGPT, and Google Gemini.

You might also like

Cesar Cadenas has been writing about the tech industry for several years now specializing in consumer electronics, entertainment devices, Windows, and the gaming industry. But he’s also passionate about smartphones, GPUs, and cybersecurity.

Google Gemini is set to finally reach its full potential – and take over from Google Assistant – thanks to a major upgrade

Anthropic’s new Claude 3.5 Haiku AI model is 4 times more expensive than its predecessor

How to turn off Meta AI