10 new AI features that’s coming to Google’s Pixel phones

Google brings 10 new AI features to its Pixel smartphones including Gemini Live and Add me, enabling it to be not just a ‘smart’ but ‘AI-smart’ phone.

Google recently launched nearly a dozen of new AI features for its Pixel phones while introducing its new Pixel 9 Series and they all explain how Google plans to implement AI to our day-to-day life. The competency to blend AI in our daily life surges as smartphone brands strives to deliver high-end performance and productivity using the new generative-AI.

With a motive to enhance user experience and efficiency, companies start pulling off artificial intelligence technology to software, hardware or wherever is possible. Google is one such company which incorporated AI to almost all its applications and services.

And in the recent ‘Made by Google 2024’ event, Google unleashed 10 new features for Google Pixel smartphones. The features now exclusively available only to top-end Pixel phones, may soon be rolled out to all smartphones, either through Android or by other smartphone brands copying it.

New Assistant – Gemini

Gemini is fully refurbished now with much faster and high-quality responses. Google’s Gemini 1.5 Flash, new AI model from Google supporting Gemini will enable the AI to be smarter and avoid errors. Gemini as voice assistant, will also get access to many Google apps like Keep, Tasks, Utilities and Google Calendar, enabling the users to pull information from these apps. You can also command Gemini to do something for you in these apps. Google Pixel phones let you to access Gemini by simply pressing the Power button.

Gemini Live

Google introduces an AI voice chat “Gemini Live” to compete with ChatGPT’s voice chat. The AI will have a natural conversation with you just like in Her movie. You can ask anything to Gemini, interrupt, and argue with Gemini. Google allows you to access Gemini Live even if the screen is locked. The AI voice chat feature is only available for Gemini Advanced subscribers, though.

Add me for Photos

One interesting feature Google had come up with is this “Add Me” for photos, which is unique and helps clicking a group photo with your friends and family, ensuring no one is left out. Add Me uses augmented reality and AI to include the photographer too in the photo in a smart way. Just take a picture of your friends, and then hand your phone off to take another picture and step into the same spot they were in. The camera will then blend the two images together, as if you all were standing together. The AR will guide you to be in the camera frame without disturbing others. Add Me will be available on all Pixel 9 phones, Google said.

Pixel Studio

Google now eases to create photos using generative-AI by launching a new app. Dubbed as “Pixel Studio”, it is Google’s first AI-image-generator app that’s powered by on-device diffusion model running on Tensor G4 of Pixel 9 Series. It exploits Google’s Imagen 3 text-to-image model in the cloud to generate realistic images. It allows you to generate images, stickers and edit images with text prompts.

AI-powered Weather app

The new Pixel Weather app uses AI to supplement traditional weather reporting so you get even more accurate forecasts, like when the rain is going to start and stop. Gemini Nano also generates a custom weather report so you don’t have to scroll through a bunch of numbers to get a sense of the day’s weather. Plus you can customize the app based on your needs — you can move the weather info that is most important to you like UV index or air quality index so you can easily see it without scrolling.

---

---

Gemini + Google Keep

The blend of AI with daily usable apps feels like you have an assistant to do your tasks. Integrating Gemini with Google Keep is one such example. Now, Gemini AI will help you create lists in Google Keep. All you have to do is open Keep and have Gemini help you create a list for whatever it is you need, whether that’s your weekly grocery shopping trip for a family of four or a to-do- list for you upcoming camping trip.

Pixel Screenshots

The new Pixel Screenshots app helps you save, organize and recall information from screenshots you’ve taken. For example, if you have a screenshot of a door code for an upcoming vacation stay but can’t remember it when you arrive, you can simply ask Pixel Screenshots to quickly and easily find it for you.

Call Notes

It could be difficult to note down the details of a business call, when you are multitasking, which happens usually in corporate life. This new feature called “Call Notes” by Google will help you in taking summary of your conversation after a phone call. Call Notes will listen to your call and note it down the details and transcript will be available in the call log.

If you think it hinders your privacy, Google says that this feature runs fully on-device and everyone on call will be notified if you have activated the feature.

Ask about this Screen

Google took a cue from Apple, too, giving Gemini the ability to respond to you based on what’s on your phone screen when you ask it. The company says that after summoning Gemini, you can tap “Ask about this screen” or “Ask about this video” to direct the model to what you’re looking at for contextual replies. Google says this means Gemini can do things like add a list of restaurants from a YouTube travel video to Google Maps.

Circle to Search

Google is adding what it says is an AI-powered ability to share parts of an image or of your screen when you use Circle to Search. After you’ve circled the portion you want, you can tap a new share button to send it via text — it’s basically cropping part of an image to share but without all the usual rigmarole of editing an image.

Which feature do you like the most? Tell us in the comments..

---

(For more such interesting informational, technology and innovation stuffs, keep reading The Inner Detail).