News for hackers. Stuff that matters.
Re:Self Driving Desktop by mcklaw on Wednesday May 08, 2019 @01:39AM (#19856137)
One of the most unknown tools (>10 years) http://sikulix.com/ It allows play mouse/keyboard event scrips BUT it allows to find components (coords) via screen OCR so you can make your scripts multi resolution/desktop independent. Also, it's Java based so you can play it multi SO.
Re:Self Driving Desktop by flarg on Wednesday May 08, 2019 @02:09AM (#19856280)
This is an excellent tool! But you forgot to mention that the user codes it in python, it comes with a purpose built ide, it recognises both text and images the latter with an approximation capability.
Re:Self Driving Desktop by nitrogen on Wednesday May 08, 2019 @02:29AM (#19856355)
There are a number of other commercial and free desktop automation tools that exist, some of which I've used to automate GUI testing in the past.

https://en.m.wikipedia.org/wiki/Comparison_of_GUI_testing_to...

My favorite on the Windows side was vTask Studio, but it looks like the domain is down and the link was removed from that wiki page.

Re:Self Driving Desktop by Thoth0 on Wednesday May 08, 2019 @10:47AM (#19859289)
You can still grab vTask Studio via the WBM, thanks for that, shall be trying it out;

https://web.archive.org/web/20170927151003/http://www.vtasks...

Re:Self Driving Desktop by shoo on Wednesday May 08, 2019 @07:10AM (#19857703)
Yeah! I've used sikuli to automate some legacy ui-driven application with an embedded scripting engine-- wanted to rig CI to run an automated test suite to test scripts that executed in the application, but there needed to be lots of pointing and clicking to get the app into a state where it was willing to execute scripts. Sikuli was handy! The embedded image recognition is cool and pretty easy to use -- detecting the buttons certainly wasn't the most fragile part of that rube goldberg test automation setup
Re:Self Driving Desktop by eastendguy on Wednesday May 08, 2019 @04:23PM (#19862526)
I don't think Sikuli is unknown at all - I have used it for a long time. But there has not been much progress over the last years, especially the OCR features are lacking. A good alternative to Sikuli is the newer Kantu, which is also much easier to install (just a browser extension + small native EXE).

https://a9t9.com/kantu/x/desktop-automation

Re:Self Driving Desktop by ladberg on Wednesday May 08, 2019 @03:16AM (#19856580)
Sikuli is amazing! I've used it (to great success) for data processing automation and MMO grinding.