Hasn't Google been doing this forever? I can search random things in my photos (like pictures of an old car I owned).
The new LLM-ish tools promise that users can be more vague and casual in what language they use and more elaborate in how specific they mean to be; and that the queries (and operations) can span more diverse data sources.
https://blog.google/products/photos/ask-photos-google-io-202...
I have my sister’s dogs named in my google photos library. Every time I a take a picture of either dog, they are automatically tagged and added to a shared album I set up for my sister.
I have nieces and nephews with photos from newborn age to 10+ years old, and it has managed to organize them across their growth and ages. It’s incredible. I can search for “<niece name> <vacation area>” and get every photo of her on a certain vacation to make a family scrap book.
Apple photos search and tagging is pitiful in comparison.
But that whole find me something on my mutliple gigabytes of storage on my device account definitely seems like the mass appeal
This is such a mundane use of AI, but unsurprising Apple would sell it as revolutionary.
That is in contrast to a lot of fancy AI demos which are a great party trick, but fall apart in actual usage, with their reliability being “maybe it will work this time, maybe it won’t, just keep retrying :)”.
Apple is pretty well-recognized for usually being a bit late to the party, but at least delivering stuff that’s polished.
Just look at this thread of people sharing how Gemini broke all their commands and automations. The Apple Intelligence Siri on the other hand works just fine (even if new features are arriving slowly).
The difference between whether someone has 4 or 5 fingers, whether they're holding a gun versus a random object, or whether they're mixed-race or caucasian, all seem like they would be pretty important things. Likewise, car number plates, signage in the photo that help identify where it is, metadata of the image itself (often more useful than the image), are all incredibly important. All of those are things that AI is absolutely terrible at lmao.
I'm not sure how a bunch of probably-correct keywords that miss a lot of the important aforementioned details in the image is more useful than the image itself, or it's metadata. Both of which would be lost. My point applies equally with respect to image classification, too.
Apple's approach of using current-boom AI to help you navigate and digest your own private trove of multimedia content (photos, videos, apps, notes, structured data, etc) is absolutely useful to people as well, and for some of us, one of the only personal uses of this AI that seems compelling at all.
I'm much more excited to have help finding that goofy picture of my cat by describing what I remember, so I can share it with a friend, than I am to have some chatbot dialog about entry-level Python with a hallucinating parlor trick.
But these features have to work, and work well, and work fast, and be widely known to work, before they'll really win the market. But that's going to take a minute and it might not even happen.