News for hackers. Stuff that matters.

A comment on You can't solve computer use by ignoring the interface.

Re:You can't solve computer use by ignoring the interface by _doctor_love on Thursday July 30, 2026 @12:59PM (#49112672)
I wonder if we will see people building these kinds of computer use systems to augment traditional QA. What I do not have my mind wrapped around at the moment is how agents might reason across the different states of the interface. It seems like it should be possible to build some kind of state machine for this?
[ Parent | on HN ]
Re:You can't solve computer use by ignoring the interface by mpavlov on Thursday July 30, 2026 @01:27PM (#49113018)
You mean all the possible states of the each element of the interface (buttons, forms, content blocks, etc.)?
[ Parent | on HN ]
Re:You can't solve computer use by ignoring the interface by _doctor_love on Thursday July 30, 2026 @02:43PM (#49113965)
No, not to that level of detail. There's a higher-level set of states that all other states should be derivable from.
[ Parent | on HN ]