You Can Try These New AI Accessibility Features on Your Old Pixel
At Made by Google 2024, Google introduced several important new artificial intelligence features . For example, if you buy a Pixel 9 or Pixel 9 Pro Fold , you can try Add Me, a feature that lets you take a photo of an entire group without an additional photographer. This is a cool feature, but it requires a brand new Pixel.
However , not everything Google announced yesterday requires you to update your smartphone . In fact, the company announced four new AI changes to accessibility features that apply to phones that are three to four years old. If you have a Pixel 5 or newer, you’ll see at least some AI features on your phone.
Managed Frame Updates (Pixel 6 and later)
Google introduced Guided Frame back in 2022 as a feature to help blind and visually impaired users take photos. Guided Frame will speak out loud instructions to users on how to position the camera, whether you’re taking a selfie or photographing someone else.
This year, Google is adding two key updates to Guided Frame: The company says Guided Frame has better subject recognition, has “intelligent face filtering” in group photos, and can better focus on objects in busy shots. The end result should be an improved frame with guides that will help users better compose their photos.
Secondly, the Guided Frame feature is now available in your camera settings. This feature was previously exclusive to TalkBack , the screen reader built into Android. If you don’t use screen readers or just want easier access to the controllable frame, it’s now in the camera app.
Changes to Magnifier (Pixel 5 and later)
The Google Magnifier app is designed for users who have trouble seeing small details up close: you use the app to magnify those objects and adjust the image quality to make them easier to see and read.
Following Made by Google, the company announced four new changes to the application based on artificial intelligence. Going forward, you’ll be able to search for words inside the frame: If you’re looking for something specific, like a menu item, you can search for the word “burger” while keeping the menu within the magnifying glass frame. If there is a hamburger on the menu, it will appear.
There’s also now a picture-in-picture mode that lets you follow a larger frame while zooming in. When you zoom in on a frame, you’ll see an outline of where you’re zoomed in, which seems like useful context so you don’t get lost when scrolling through the finer details of the image.
The app now allows you to use multiple lenses for different purposes: whether you want to use your Pixel’s macro lens to really maximize detail, or switch to a wide-angle lens to see more of your surroundings, you can. Finally, Magnifier now supports the front camera, so you can use the app as a quick mirror.
New Live Transcribe mode for foldable devices.
When Live Transcribe is turned on, it will record what you and your partner say during a call. This is a great tool for hearing impaired users as they can follow what the other person is saying in real time using these captions.
If you have a foldable phone, you can try the new Live Transcription mode: You can now use this feature on both screens of your foldable phone: Each speaker’s transcripts appear on both screens, meaning you can follow them in both directions.
New languages for Live Caption and Live Transcribe.
Similar to Live Transcribe, Live Caption adds subtitles to any audio on your Android device. Google says they are now adding support for Korean, Polish, Portuguese, Russian, Chinese, Turkish, and Vietnamese to both Live Caption and Live Transcribe. If you need a video in one of these languages, the subtitles should now appear in real time; If you’re having a conversation in one of these languages, Live Transcribe will have no problem documenting it.
While Live Caption works on Pixel 2 and later, you’ll need a Pixel 6 or later to try out the new languages.