Google’s Biggest New AI Features Are Coming to Pixel 10 Phones
The new Pixel 10 series is, as expected, all about AI . But it’s more subtle. Gemini has become a staple of many Android phones, not just the Pixel, so the focus is on what the Pixel can do differently: use its new chip designed specifically for AI to implement small, built-in AI features that other phones can’t. Here are all the big AI features coming exclusively to the Pixel 10 series (including the Pro and Fold) this year.
New chip with artificial intelligence for on-device data processing
At the heart of all these changes is the new Tensor G5 chip. It’s Google’s biggest silicon upgrade to date. Google switched to TSMC’s latest 3nm process instead of Samsung’s foundries, meaning it’s entirely custom-made. According to Google, this has resulted in an overall performance boost of about 34%, but more importantly, the onboard Tensor processor, which handles AI tasks, is now 60% faster than before.
This means Google can run its lightweight Gemini Nano model more efficiently and dynamically, quickly switching between sub-models depending on the use case.
Now, almost all of the new AI features coming to the Pixel 10 series are processed on the device itself, allowing them to work offline and giving them more power to use your data without privacy concerns.
Magic cue
Magic Cue will be available everywhere on the Pixel 10 , but only when you need it. It’s Google’s “contextual silent computing” that puts important information and prompts you to take action when you need it. Otherwise, it just doesn’t show up.
For example, your friend texts you to ask about a restaurant reservation. Magic Cue recognizes that message, pulls relevant information from your Gmail or Google Calendar, and immediately offers it as a suggested text. You just need to tap it to send. This also works with flight information, which will appear on the screen during phone calls with the airline. This feature is built into most major Google apps, such as Gmail, Calendar, Screenshots, Messages, and more.
Editing Images with Gemini
With Pixel 10, you no longer have to use buttons and sliders to edit images. Google is integrating Gemini right into the image editor in the Photos app . The feature will first appear on Pixel 10 in the US.
With Gemini, you can edit images with voice or text and get real-time responses. You can issue commands like “remove cars in the background” or “restore an old photo.” If you’re not sure what you want, you can simply say, “make it better.”
AI-powered image editing also raises some concerns about whether what you see is real. To get around this, Google is adding a C2PA content credentials feature to Google Photos that allows users to view a photo’s metadata and check for any AI use in its creation.
Camera Trainer
The Pixel camera has a new AI mode built into it that’s not just for editing or enhancing images. It helps you, the user, take better photos from the start. Note: Google told Lifehacker that this mode sends photos to the cloud, but also noted that they’re deleted once you’re done using the feature.
Essentially, Camera Coach analyzes a photo and gives you tips or suggestions to improve the shot. It might tell you to take a few steps back or turn your phone to make your subject appear taller. It might also recommend changing your angle if the lighting is too harsh, and use artificial intelligence to create scenarios that weren’t in the original photo.
AI Voice Translation That Sounds Like You
Pixel’s Phone app is getting live AI translation. The Pixel 10 can translate calls in real time using speech-to-speech, and even sync the AI voice being translated with the speaker. This means two people can have a conversation in their native languages. There’s no in-depth training required to use the AI clone. As you speak, the voice will adjust to your intonation and nuances. Again, this all happens on-device, so it’s fast. The feature works with English and Spanish, German, Japanese, French, Hindi, Italian, Portuguese, Swedish, Russian, and Indonesian.
Gemini Live Camera View Highlights
Gemini Live will come to Pixel phones on August 28 (as well as other supported Android phones) in a few small ways. The main new feature is Gemini’s ability to highlight objects on the screen. Gemini highlights the area it wants to focus on and dims the rest of the screen. Gemini Live will also be able to interact with more apps, including Messages, Phone, and Clock.
Handling missed calls with AI
Google is also adding AI features to missed calls. The “Take Message” feature will now provide a real-time transcript of the incoming call, but that’s not all. You’ll get a summary and actionable instructions based on the voicemail.