News for hackers. Stuff that matters.
Re:Gio – write immediate-mode GUI programs in Go by amelius on Wednesday May 26, 2021 @07:31AM (#27289111)
In my opinion, accessibility should be implemented at the OS level. The OS can, for example, run OCR on the entire screen and turn bitmaps into selectable text, read text out loud, etc. This kind of functionality shouldn't be replicated on a per-app basis. Accessibility of browsers is usually considered to be very good, but browsers are almost OSes, so why not lift this one more level into the OS?
Re:Gio – write immediate-mode GUI programs in Go by masklinn on Wednesday May 26, 2021 @02:13PM (#27294046)
> In my opinion, accessibility should be implemented at the OS level.

Which it is. Apple has been praised for the accessibility of both macOS and iOS for years if not decades, accessibility concerns have been baked into Cocoa forever. And accessibility is literally a top level category of the Settings app.

And I know that Windows has been improving by leaps and bounds.

> The OS can, for example, run OCR on the entire screen and turn bitmaps into selectable text, read text out loud, etc

That exists (look up VoiceOver Recognition). However it can not be reliable, and will never be anywhere near as good as actual semantic annotation.

Image recognition has no way to understand that the physical UI layout has no relation to its logical setup, nor does it have any way to differentiate between semantic and decorative content, or to see through invisibility to know that a button is a menu versus an action.

Re:Gio – write immediate-mode GUI programs in Go by zxzax on Wednesday May 26, 2021 @01:14PM (#27293274)
That is not really going to work, at all. To have a good experience, a screen reader needs more contextual information than just the text.
Re:Gio – write immediate-mode GUI programs in Go by p_l on Wednesday May 26, 2021 @05:45PM (#27296498)
OSes do provide accessibility APIs - and usually if you use one of the more supported graphic toolkits there are somewhat easy ways to integrate directly in semantic ways, without needing to OCR and do fortune telling.

Usually it means that you need a deferred mode semantic tree of the application for accessibility UI to walk through, though.