I've _tried_ searching in Google Photos before, it just didn't work reliably enough for me try it more frequently (usually searching for more specific stuff than something like "pets with children," though I can't recall any exact examples right now). Searching for location works well, but that's not very hard.
For example, I took a picture of my driver's license a year or so ago, and needed the number on a form recently. I just went to Google Photos and searched for "driver's license." Sure enough, the old picture showed up, even though I never manually tagged it.
OTOH, if I ask Google Photos to show me pictures of me on the beach with my friends X and Y, it shows me a picture from 2005, of exactly what I asked. (literally "me on the beach with X and Y").
And if I ask for pictures of me and my friend Z in a party, it shows me pictures of me at Z's wedding 4 years ago. (literally "me with Z in a party").
That must account for a huge portion of their advances, right?
I find this to be a general trend with Google: they may have more advanced AI, but haven't yet figured out super-useful ways to apply it.
They also are perfectly willing to undercut their own AI to serve business goals: the Assistant on my Pixel wouldn't even let me do "hey google set a timer for five minutes" if I didn't give Google my full location history. Because you need that to set timers...