News for hackers. Stuff that matters.
Re:Changes we're making to Google Assistant by pianohacker on Friday January 12, 2024 @07:37PM (#38976131)
I'm pretty convinced this is because the app switcher can recognize _whether_ a part of an app's UI is a native text field and not just an image, but it's not smart enough to pull the text out. I've seen it make number 0 -> letter O and other such mistakes before, so I'm convinced it's using OCR. Which is probably harder for Chinese.

It's crazy to me that it can't just use the accessibility APIs.

Re:Changes we're making to Google Assistant by theblazehen on Saturday January 13, 2024 @08:19AM (#38979659)
It is indeed using OCR. You can even copy text out of a screenshot of text in this way