News for hackers. Stuff that matters.
Re:Ask HN: Vision Models to Parse UI by orev on Tuesday January 24, 2023 @12:27PM (#34506830)
I think you need to think outside the Web in those one. The web already has many ways to access UI elements, like the DOM, CSS selectors, etc.

This is really more useful for things like desktop GUIs where you have no other option than to OCR then inject mouse clicks.

Re:Ask HN: Vision Models to Parse UI by wruza on Wednesday January 25, 2023 @05:57PM (#34525338)
Is there an OCR that reports character coordinates? Couldn’t find a tesseract-ocr option for that, but maybe it’s in a block-detector-something source code?