Apple’s ‘Visual Intelligence’ Can Now Actually See Your Screen
Last year, Apple introduced Visual Intelligence , which uses your camera to translate text, identify objects, or trigger searches by pointing your phone at something. But if what you want to know is on your phone rather than in front of it, you’re out of luck. Until today’s WWDC announcement , that is.
The new Visual Intelligence update will allow users to take a screenshot of what’s on their phone and search for the image’s contents. If you’re looking at an object, the feature can search to find where you can buy it online. You can also bring up a ChatGPT window to ask questions about what you’re looking at.
Perhaps most usefully, Visual Intelligence can suggest calendar events from screenshots. So you can remember all those music festivals, conventions, or shows at your local bar that you find on Instagram. Honestly, this might be the coolest and most useful AI feature I’ve seen on any platform in a while.