News for hackers. Stuff that matters.
Re:Extracting concepts from GPT-4 by ein0p on Friday June 07, 2024 @01:15AM (#40605549)
We know exactly what the system is capable of doing. It’s capable of outputting tokens which can then be converted into text.
Re:Extracting concepts from GPT-4 by reducesuffering on Friday June 07, 2024 @02:07AM (#40605753)
And social media manipulation is just registers and bytes, wait no, sand and electrons.
Re:Extracting concepts from GPT-4 by isaacremuant on Friday June 07, 2024 @03:21AM (#40606108)
Just because you can do something with technology doesn't mean the problem is technology itself. It's like newspapers. Printing them I technology and allows all kind of things. If you're of the authoritarian mindset, you'll want to control it all out of some stated fear, but you can do that for everything.
Re:Extracting concepts from GPT-4 by friendzis on Friday June 07, 2024 @09:27AM (#40608503)
If you can do something with technology, that something is part of risk assessment. Authoritarianism is irrelevant, that's engineering.
Re:Extracting concepts from GPT-4 by ben_w on Friday June 07, 2024 @05:40AM (#40606942)
Which is so broad as to be unhelpful.

We also know that petroleum mixed with air may be combusted to release energy; we needed to characterise this much better in order for the motor car to be distinguishable from a fuel-air bomb.

Re:Extracting concepts from GPT-4 by ein0p on Friday June 07, 2024 @11:47AM (#40609777)
And that's exactly my point. Regulating the underlying tech is utterly pointless in this case - it's utterly harmless by itself.
Re:Extracting concepts from GPT-4 by ben_w on Friday June 07, 2024 @01:50PM (#40611045)
That's exactly wrong, we know some things that can be expressed as "a sequence of tokens" are harmful and indeed have already made them crimes.

What we need is to characterise what is possible so we can skip the AI equivalent of Union Carbide in Bohopal.

Re:Extracting concepts from GPT-4 by ein0p on Friday June 07, 2024 @03:04PM (#40611814)
Yes, but we also know that a knife can be used to slice vegetables or stab people, and we still allow knives. I can go to Google right now and easily find out how to make Sarin or ricin at home. Are you suggesting that we should ban Google Search because of that?
Re:Extracting concepts from GPT-4 by ben_w on Friday June 07, 2024 @03:27PM (#40612048)
> Yes, but we also know that a knife can be used to slice vegetables or stab people, and we still allow knives.

I'm from the UK originally, and guess what.

Also missing the point, given stabbing is a crime; what's the AI equivalent of a stabbing? Does anyone on the planet know?

> I can go to Google right now and easily find out how to make Sarin or ricin at home. Are you suggesting that we should ban Google Search because of that?

Google search has restrictions on what you can search for, and on what results it can return. The question is where to set those thresholds, those limits — and politicians do regularly argue about this for all kinds of reasons much weaker than actual toxins. The current fight in the US over Section 230 looks like it's about what can and can't be done and by whom and who is considered liable for unlawful content, despite the USA being (IMO) the global outlier in favour of free speech due to its maximalist attitude and constitution.

People joke about getting on watchlists due to their searches, and at least one YouTuber I follow has had agents show up to investigate their purchases.

Facebook got flack from the UN because they failed to have appropriate limits on their systems, leading to their platform being used to orchestrate the (still ongoing) genocide in Myanmar.

What's being asked for here is not the equivalent of "ban google search", it's "figure out the extent to which we need an equivalent of Section 230, an equivalent of law enforcement cooperation, an equivalent of spam filtering, an equivalent of the right to be forgotten, of etc." — we don't even have the questions yet, we have the analogies, that's all, and analogies aren't good enough regardless of if the system that you fear might do wrong is an AI or a regulatory body.

Re:Extracting concepts from GPT-4 by ein0p on Friday June 07, 2024 @04:15PM (#40612509)
What, you aren’t allowed to own kitchen knives? Or Google search somehow doesn’t return the chemical processes to make Sarin? Come on now.
Re:Extracting concepts from GPT-4 by ben_w on Friday June 07, 2024 @04:42PM (#40612754)
> What, you aren’t allowed to own kitchen knives?

You're not allowed to be in possession of a knife in public without a good reason.

https://www.gov.uk/buying-carrying-knives

You may think the UK government is nuts (I do, I left due to an unrelated law), but it is what it is.

> Or Google search somehow doesn’t return the chemical processes to make Sarin?

You're still missing the point of everything I've said if you think that's even a good rhetorical question.

I have no idea if that's me giving bad descriptions, or you being primed with the exact false world model I'm trying to convince you to change from.

Hill climbing sometimes involves going down one local peak before you can climb the global.

Again, and I don't know how to make this clearer, I am not calling for an undifferentiated ban on all AI just because they can be used for bad ends, I'm saying that we need to figure out how to even tell which uses are even the bad ones.

Your original text was:

> We know exactly what the system is capable of doing. It’s capable of outputting tokens which can then be converted into text

Well, we know exactly what a knife is capable of doing.

Does that knowledge mean we allow stabbing? Of course not!

What's the AI equivalent of a stabbing? Nobody knows.

Re:Extracting concepts from GPT-4 by ein0p on Friday June 07, 2024 @05:06PM (#40612989)
Same as you’re not allowed to commit eg election or postal fraud using LLMs. Are you allowed to carry a hammer? You can use that to kill people. You can also mow them down with a car, push them in front of a train with your bare hands, poison them with otherwise benign household chemicals and so on. It’s the applications that should be regulated, not the underlying tech