Latest Version of Android Has Gemini AI at Its Core

Google today announced several new AI features that it is building into the Android 15 operating system, giving us some insight into what Apple's iPhone operating system will be competing with later this year.

android ai
According to Google, Android has been designed with AI at its core, and Gemini is a foundational part of the Android experience that works at the system level. There is an AI powered search bar that can be used for answering queries and looking up information, and the Circle to Search feature can be used for solving math and physics problems or getting homework help as of today.

Gemini serves as the AI assistant on Android instead of Google Assistant, and the Gemini AI will be able to be brought up as an overlay on any app that's in use. Gemini is context aware and can anticipate what the smartphone user is doing and provide context in the moment. It can create images for texts and social media, or answer questions about a video that's being watched. It can parse PDFs, websites, and other content, providing summaries and translating.

Google is using on-device AI for some features in order to keep sensitive data private, and this is also Apple's plan. Multiple rumors have suggested that many of Apple's first AI features will run on-device rather than through a cloud server.

Gemini Nano, Google's on-device AI, currently does things like generate smart replies in messaging apps and summarize voice memos. Gemini Nano with Multimodality is coming to Pixel phones later this year, enabling new on-device AI features like TalkBack, which can help blind and low-vision users better interpret the world around them. Google is also developing a call screening feature that actively listens to calls and lets users know if it sounds like a scam.

Google today also announced Gemini 1.5 Flash, a lightweight version of its Gemini Pro AI model. Gemini Flash is more efficient, less expensive, and has lower latency, which makes it ideal for large scale rollouts. Google says that Gemini 1.5 Flash is able to deliver "impressive quality" for its size, excelling at summarization, chat applications, image and video captioning, and data extraction from long documents.

Gemini 1.5 Pro has also been improved and it is able to follow increasingly complex and nuanced instructions, including parsing documents up to 1,500 pages long or an hour of video content. Gemini can be interacted with in Google Messages, and Gemini Advanced subscribers will be able to experience a new mobile conversational experience that makes speaking with Gemini more intuitive. Customized versions of Gemini called Gems are also available to subscribers, for personalized assistants that can help with workouts, provide recipes, and more, with specific personalities.

Project Astra, another Google effort, focuses on AI agents that can be helpful in everyday life. Google demoed prototype agents able to identify objects, provide context on information from the camera, and recall a timeline of events for finding a lost item.

Google plans to provide more information on new features coming to Android 15 later this week.

Popular Stories

iOS 18 Siri Integrated Feature

Report: These 10 New AI Features Are Coming in iOS 18

Sunday May 26, 2024 12:57 pm PDT by
iOS 18 and macOS 15 will offer an array of new AI features such as auto-generated emojis, suggested replies to emails and messages, and more, Bloomberg's Mark Gurman reports. A significant portion of Apple's Worldwide Developers Conference (WWDC) is expected to focus on AI features. Writing his latest "Power On" newsletter, Gurman explained that Apple's AI strategy emphasizes providing...
new best buy blue

Best Buy's Memorial Day Sale Has Record Low Prices on iPads, MacBooks, and Much More

Friday May 24, 2024 7:12 am PDT by
Best Buy today kicked off its Memorial Day weekend sale, and it has some of the best prices we've tracked in weeks on iPads and MacBooks. Specifically, you'll find record low prices on the 5th generation iPad Air, iPad mini 6, M2 MacBook Air, and M3 MacBook Pro. Note: MacRumors is an affiliate partner with Best Buy. When you click a link and make a purchase, we may receive a small payment,...
iOS 18 WWDC 24 Feature 2

Gurman: iOS 18 Will Allow Users to Recolor App Icons and Place Them Anywhere

Sunday May 26, 2024 12:22 pm PDT by
Apple's iOS 18 update will introduce new features for further customizing the iPhone's home screen, according to Bloomberg's Mark Gurman. In the latest edition of his "Power On" newsletter, Gurman claimed that Apple will allow users to change the color of app icons in iOS 18. For example, "you can make all your social icons blue or finance-related ones green." This kind of home screen...
Apple iPhone 14 color lineup feature

Apple Now Selling Refurbished iPhone 14 Models

Friday May 24, 2024 11:15 am PDT by
Apple today added refurbished iPhone 14, iPhone 14 Plus, iPhone 14 Pro, and iPhone 14 Pro Max devices to its online store for refurbished products, offering the prior-generation iPhones at a discount for the first time since their 2022 launch. The iPhone 14 is available starting at $619, the iPhone 14 Pro is available starting at $759, and the iPhone 14 Pro Max is available starting at $849. ...
top stories 25may2024

Top Stories: iOS 17.5.1 Fixes Concerning Photos Bug, All-New iPhone 17 Model Rumored, and More

Saturday May 25, 2024 6:00 am PDT by
It's been quite a week of Apple news and rumors, ranging from a concerning bug with deleted photos reappearing on users' devices to hot rumors about a new high-end iPhone model for 2025 and a MacBook with a foldable screen coming as soon as 2026. Other news and rumors this week included fresh expectations for iOS 18 features and new headphones from Sonos to compete head-to-head with AirPods...

Top Rated Comments

Klae17 Avatar
2 weeks ago
Google's approach to AI: Roll out to as many users as possible.

Apple's probable approach to AI: New Apple Pencil only works on new iPads, Old pencils will not work on new iPads for no reason effing other than greed.
Score: 47 Votes (Like | Disagree)
SmugMaverick Avatar
2 weeks ago
It’s funny because Apple is so far behind these features it’s hilarious.

iOS is literally fisher price OS compared to Android with AI.

Photos search, circle to search, Gemini assistant etc are utterly amazing and nothing iOS has right now compares.

But hey, we’re getting another button!
Score: 33 Votes (Like | Disagree)
corrado7 Avatar
2 weeks ago
I hope Apple doesnt spend all their time talking about AI at WWDC
Score: 27 Votes (Like | Disagree)
PsykX Avatar
2 weeks ago

Photos search
Photos Search in iOS has had AI for actually a very long time already.
You can search for objects if you want, it works rather well.
Score: 24 Votes (Like | Disagree)
JacquesleMac Avatar
2 weeks ago

It’s funny because Apple is so far behind these features it’s hilarious.
How about the knowledge that your OS isn't parsing every piece of info you give it to search for monetisable data?

Isn't that worth anything to you?
Score: 24 Votes (Like | Disagree)
Premium1 Avatar
2 weeks ago

It’s funny because Apple is so far behind these features it’s hilarious.

iOS is literally fisher price OS compared to Android with AI.

Photos search, circle to search, Gemini assistant etc are utterly amazing and nothing iOS has right now compares.

But hey, we’re getting another button!
Apple will push out some new stickers and emojis and call it a day. They are getting left in the dust in so many regards anymore.
Score: 21 Votes (Like | Disagree)