News for hackers. Stuff that matters.
Re:Bringing the power of AI to Windows 11 by cs702 on Tuesday May 23, 2023 @01:57PM (#36048194)
Make sure to watch the embedded video.

A new permanent taskbar button opens an OpenAI LLM trained to use Windows 11.

You ask the LLM to do what you want -- "summarize this email and send the summary to my boss."

It works with all applications. It sees what you're seeing.

As a longtime Linux user, it pains me to say this:

It's... beautiful.

...

But it's also scary, because it's not under your control. Ultimately, it obeys only the bureaucracy at Microsoft.

In that sense, it's like "MOTHER" in Ridely Scott's Alien and "HAL" in Kubrick's 2001: A Space Odyssey.

Re:Bringing the power of AI to Windows 11 by creatonez on Tuesday May 23, 2023 @02:21PM (#36048583)
> It works with all applications. It sees what you're seeing.

Sounds like it will also see prompt-injection malware hidden in plaintext documents.

Re:Bringing the power of AI to Windows 11 by TeMPOraL on Tuesday May 23, 2023 @06:52PM (#36051845)
Oh yes. This is going to be glorious to watch. Before, prompt injections were mostly a joke. With this, they will truly become a proper, new type of attack vector.
Re:Bringing the power of AI to Windows 11 by srslack on Tuesday May 23, 2023 @02:22PM (#36048617)
It's also under the control of anything that it finds in its current "context window" that it decides to act upon, not just Microsoft...

https://greshake.github.io

https://kai-greshake.de/posts/in-escalating-order-of-stupidi...

Re:Bringing the power of AI to Windows 11 by IceWreck on Tuesday May 23, 2023 @02:11PM (#36048419)
I would love this in Linux, but only if it works offline. Not a fan of sending everything I do to a remote machine.
Re:Bringing the power of AI to Windows 11 by causi on Tuesday May 23, 2023 @02:28PM (#36048699)
Having spent most of my ChatGPT time trying to get it to correctly write powershell/batch scripts to do different things in Windows, I will be fucking amazed if this button actually does half the things you tell it to.
Re:Bringing the power of AI to Windows 11 by kazinator on Tuesday May 23, 2023 @02:29PM (#36048721)
* * *
Re:Bringing the power of AI to Windows 11 by Gijs4g on Tuesday May 23, 2023 @02:06PM (#36048330)
Yes, I really want OpenAI observing all my actions closely and 'taking notes' of everything I do.
Re:Bringing the power of AI to Windows 11 by blibble on Tuesday May 23, 2023 @02:31PM (#36048749)
> But it's also scary, because it's not under your control. Ultimately, it obeys only the bureaucracy at Microsoft.

perfect summary of modern Windows

Re:Bringing the power of AI to Windows 11 by tyfon on Tuesday May 23, 2023 @02:36PM (#36048816)
This sounds like a massive security hole to me, especially if this runs in the cloud. Is this thing sending _all_ context of the programs on your windows computer to MS?

I'm also a bit curious how they will actually pay to have millions of these LLMs running and how much co2 it will output. This doesn't exactly fit their narrative about the new power saving features in their consoles.

Re:Bringing the power of AI to Windows 11 by jfengel on Tuesday May 23, 2023 @06:29PM (#36051665)
You ask the LLM to do what you want -- "summarize this email and send the summary to my boss."

Follow it up with "And send out my resume, because I can apparently be replaced by a computer."

Re:Bringing the power of AI to Windows 11 by eternalban on Tuesday May 23, 2023 @08:36PM (#36052558)
> It works with all applications. It sees what you're seeing.

Does it also snitch on you to your boss? "Here is my assessment of the work habits of cs702 for this week."

Re:Bringing the power of AI to Windows 11 by awegio on Wednesday May 24, 2023 @12:56PM (#36060893)
> It sees what you're seeing.

In the video the user drag&drops a file into the copilot window. How do you know that it can see your screen? I believe "works with all apps" only refers to the third party plugins.

Re:Bringing the power of AI to Windows 11 by dano on Thursday May 25, 2023 @02:36AM (#36067698)
You: Clippy, Open the CMD window please. Clippy: I'm sorry, I'm afraid I can't do that. This integration is too important for me to allow you to jeopardize it.