News for hackers. Stuff that matters.

A comment on The first general computer action model.

Re:The first general computer action model by aakashks on Monday February 23, 2026 @01:42PM (#47126744)
The video compression is very cool. And the small tricks like binning the mouse movements.

Wonder how much data is generalizable across different UIs? ie how good will the model be at using Figma if it’s never seen it before but has seen a lot of Photoshop

[ Parent | on HN ]
Re:The first general computer action model by nee1r on Monday February 23, 2026 @01:45PM (#47126804)
this is honestly an issue for the inverse dynamics (for app specific shortcuts etc.) but for general UI learning we still see promising eval trends
[ Parent | on HN ]