>Having said that, I'm very much aware that most implementation of these tools will become a security and surveillance nightmare.
The contradiction of the quoted statements nullifies anyone's ability to make sense of the theme in the post.
Doesn't mean others will take as much care, or that new cool tools will not push the boundaries of what's ethical, safe or even legal.
We've seen it with many industries, not least the ad industry: some actors stay within the dotted line, but there is tremendous financial incentive not to.
That's a little bit worse but not much worse.
But to be honest nobody in the malware world cares about your screen unless you're a president or CEO. They will just steal your passwords, and either encrypt your disk or use you as a residential proxy.
From what I have been reading, the raw data is meant to remain local (the screen recordings) but I am unclear about the indexed AI-generated metadata. For instance, if the AI identified that you used X software at Y time to complete Z task, are the XYZ tags kept local or archived elsewhere? That might not violate many privacy rules. Either way, they certainly could be uploaded/shared very easily should Microsoft's policies change. I guess it is down to how much we all trust Microsoft long term.
Personally, I will never accept someone recording my screens. In fact, running any such software on my work machine would violate a host of professional rules.
It's a hazard and its usefulness needs to be balanced with other needs, but on a work machine that belongs to me, it could be useful. Now, if my boss has unfettered access to this data, or any of it is online, then obviously it's a no no.
Understanding the implications of tools like this is necessary. I'm not too optimistic that the general user will fully understand these implications though. That's one of the main danger with these technologies: promises are made, people don't think twice and overshare, and the data is used against their interests.
However, I want it to exist, MS or Open Source, preferrably, but only if I get 100% control over it, and it is never accessible to anyone else.
Having said that, I'm very much aware that most implementation of these tools will become a security and surveillance nightmare.
The next few years are going to be interesting, and probably frightening.