Starting with iOS 15, iPadOS 15.1, and macOS 12, Apple has integrated machine learning into Photos to identify certain types of objects in photos. These include artwork, flowers and other plants, pets and animals, popular landmarks, and other less classifiable objects. Apple calls this Visual Look Up, although the name doesn’t appear in the interface.
The Photos app provides visual cues when detection is complete or a trial is available that you may not have noticed or seen without realizing how useful it can be.
In Photos for macOS, each image with a recognized item will have an icon overlaid on it in the single-image view that appears when you double-click an image. You may first need to click where the i-in-a-circle (Info) icon would normally appear in the upper-right corner. The Visual Search icon has a stylized drawing (like a bird or other category) in a circle with stars in the upper-left segment that represent stylized lens flares. This button has the tooltip text “Get info and search this photo.”
This stylized icon indicates that visual lookup matches are available.
This stylized icon indicates that visual lookup matches are available.
foundry
This stylized icon indicates that visual lookup matches are available.
foundry
foundry
Multiple icons may appear on images for which Photos makes multiple identifications. Icons can be a pin, a paw print (for animals), a bug, a leaf, etc. Click on an icon and the Visual Search window with information will appear.
In Photos for iOS or iPadOS, when viewing a single image, you’ll see the same replacement icon for the i (info) icon – here it appears at the bottom of the view. Tap it and you’ll see a link you can click, such as “Find Plant” (if no exact match was found) or “Look Up” Latin or common name with a corresponding icon next to the option. Tap the link for more information.
Photos often provide useful information about animals, plants and places (iOS, left; macOS, right).
Photos often provide useful information about animals, plants and places (iOS, left; macOS, right).
foundry
Photos often provide useful information about animals, plants and places (iOS, left; macOS, right).
foundry
foundry
The machine learning algorithm is by no means perfect. I’ve seen some really ridiculous IDs. But it’s a great starting point for places and things you have no idea what they are.
The minimum requirement is iOS 15, iPadOS 15.1 or macOS 12, and only a few languages are supported. Some iPads that can run iPadOS 15.1 do not support Visual Look Up: consult the list on this support page.
Ask Mac 911
We’ve compiled a list of the questions we get asked most often, along with answers and links to columns: Check out our Super FAQ to see if your question is there. If not, we’re always looking for new problems to solve! Email your question to [email protected], including screenshots if applicable and whether you want to use your full name. Not every question will be answered; we don’t respond to emails and can’t provide direct troubleshooting advice.
