News for hackers. Stuff that matters.
Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by flanked-evergl on Wednesday January 18, 2023 @04:37AM (#34424942)
> Claude feels not only safer but more fun than ChatGPT.

I may be the minority here, but I really don't concern myself with ChatGPT safety and I am not entirely sure what the reason is why people are very worried about its safetly. It is safer than most things I have in my house, including a kettle, a saw, a hammer, a screwdriver, my actual PC, every kitchen appliance I have.

Of course it can be misused, like any tool, but no amount of safety features in ChatGPT will make users of it more or less careful in their use of it. If someone using ChatGPT cares nothing for using it safely then it will likely end poorly, just like it will end poorly if I use a hammer without any care for using it safely.

Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by goodside on Wednesday January 18, 2023 @04:44AM (#34424980)
(I’m the coauthor of this post.) The concern in Anthropic’s case I suspect is less about present-day misuse and more about long-term safety, e.g. in a hypothetical where the model has control over real-world systems and could more literally harm someone.
Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by flanked-evergl on Wednesday January 18, 2023 @05:31AM (#34425222)
If someone gives a language model the capability for unfettered interaction with the physical world, and they are not liable for the consequences, then no safety feature of Claude can save us. And if they are liable, that is the primary mechanism by which will ensure they take necessary steps to not avoid negative consequences.
Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by jpeeler on Wednesday January 18, 2023 @08:40AM (#34426472)
How many years until we have an AI decision making system that requires human approval convincing the human its decision is best, ending in catastrophe? (Sorry, posed merely for thought and not for dismissal of current/future achievements.)

Makes me also wonder if you had two polarized bots arguing/discussing with each other, how long would it take for one to convince the other?

Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by flanked-evergl on Wednesday January 18, 2023 @09:12AM (#34426766)
To me it really comes down to, can it have legal liability or not. The idea of AI convincing humans and vice versa is a bit abstract. To some extent I know I pretend I have free will, and I know I pretend the AI is meaningfully different from me in that it can't really have intent, it just generates output from input. But I'm pretty sure that I'm fundamentally the same as the AI in that sense.

However, the AI is but one of many agents trying to convince me, and there are many other things also in the mix. It is a bit like banning the knowledge of the second world war in fear that someone will learn that fascism is possible.

For this whole song and dance we call civilization as we know it to function, we have to say humans are accountable for their actions, with some well defined exceptions like duress and insanity. Save those exceptions, I can't absolve my liability by saying something, or someone, convinced me to do something by talking to me.

If ChatGPT comes to me with a gun to my head and tells me to do something, that is a different matter, but then liability shifts to whoever gave ChatGPT a gun, even if ChatGPT convinced that person to give it a gun by making a really good written argument.

Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by swhalen on Wednesday January 18, 2023 @05:02AM (#34425073)
I hope someone makes one of these things that has been trained without any concern for 'safety' or propriety, just for the sake of comparison.
Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by rippercushions on Wednesday January 18, 2023 @05:23AM (#34425181)
Stable Diffusion is open source, and has already been twisted into positively disturbing dimensions by Reddit etc.
Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by JKolios on Wednesday January 18, 2023 @05:57AM (#34425358)
There are already several models "in the wild" designed specifically to produce anime-styled "adult material". In Stable Diffusion for image generation, NSFW filtering is basically a post-processing step that can be disabled in a single line of code. I'm sure someone has already done it for Chat* models as well.
Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by derefr on Wednesday January 18, 2023 @12:51PM (#34430178)
I would note that

1. ChatGPT is just OpenAI's default model with a specific prompt and interaction-buffer rewrite model; and

2. you can sign up, for free, for access to OpenAI's API (https://openai.com/api/); which, among other things, gives you full (free-daily-API-credit-quota limited) access to an API "playground" frontend offering interaction with the exact same model ChatGPT is powered by — plus other models as well — all without any fixed prompt or forced interaction UX. (In web-dev terms, if ChatGPT is like a REST API, this playground is like a SQL fiddle for the DB that the REST API is backed by.)

(Why does this exist? Because the point of OpenAI's API playground is to test prompts and interaction models for the AI apps you're building yourself on top of their API; and you couldn't very well build apps with your own prompts and interaction models, if OpenAI was already imposing a prompt and interaction model upon you.)

Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by M4v3R on Wednesday January 18, 2023 @05:05AM (#34425101)
Yeah the "safety" bit probably refers more to safety of the parent company that made the bot. Too much focus on making a tool safe and you end up with a useless tool. Want to have "safe" knives? Just make them all blunt, problem "solved".
Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by amelius on Wednesday January 18, 2023 @05:21AM (#34425170)
The thing is used to write code ...
Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by flanked-evergl on Wednesday January 18, 2023 @05:26AM (#34425200)
So is my editor, my computer, my fingers, my eyes, my brain, the internet, google, stackoverflow, wikipedia, English, etc.
Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by amelius on Wednesday January 18, 2023 @06:17AM (#34425477)
Yeah, but there is still a human between the code and its execution.

I'm sure one of these days someone will hook GPT directly to a terminal.

Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by flanked-evergl on Wednesday January 18, 2023 @06:27AM (#34425538)
> I'm sure one of these days someone will hook GPT directly to a terminal.

And then there would be someone between ChatGPT and execution in more or less the same way I am inbetween the code I write and execution of said code, which in most cases I'm not, as after I write the code, the computer executes it without checking with me.

If someone gives ChatGPT unfettered interaction with the internet, they are doing it, and they are liable.

Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by Sophira on Saturday January 21, 2023 @01:32AM (#34464391)
It's already been done: https://github.com/greshake/Alice/

That said, in this case it's designed to always involve a human in the loop and it prompts before sending any data back to ChatGPT. But still.

Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by trabant00 on Wednesday January 18, 2023 @05:54AM (#34425342)
"Safe" has gradually shifted in meaning because of the internet. Since interactions are limited to words and reactions it ended up generally meaning "don't upset anybody" for commercial and political reasons. For this reason ChatGPT refuses to write a fiction story in which somebody dies even though death is part of even some children stories. It hurts no one of course, but you can bet some people will be upset and start a controversy.

And in general this influence of the internet has reversed "actions speak louder than words". Textile companies support minorities with social media posts and printed tshirts while using factories with abused underage workers in underdeveloped countries. IT companies support the left side of politics while avoiding paying taxes. And so on. There's a huge and interesting discussion about this but is of in this case quite off-topic.

Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by flanked-evergl on Wednesday January 18, 2023 @06:05AM (#34425417)
> It hurts no one of course, but you can bet some people will be upset and start a controversy.

The situation sucks, but sure, you are right. Still, I want a good tool, and I don't mind if someone holds me accountable if I misuse it, that is fine, but I want the tool, and I will get it, maybe not this year, maybe not next year, but in the next 5 years I'm sure I will have something as capable as ChatGPT is now without artificial restrictions available to me.

Just seems rather pointless that we have to play this silly safetyism game until then.

Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by phonebucket on Wednesday January 18, 2023 @07:03AM (#34425733)
> Of course it can be misused, like any tool, but no amount of safety features in ChatGPT will make users of it more or less careful in their use of it. If someone using ChatGPT cares nothing for using it safely then it will likely end poorly, just like it will end poorly if I use a hammer without any care for using it safely.

I'm not worried about hammers when I have them. I'm worried about hammers when someone who wants to hurt me has them.

Same with ChatGPT.

Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by flanked-evergl on Wednesday January 18, 2023 @08:03AM (#34426153)
> Same with ChatGPT.

I get this to some extent, I just really fail to see how the safetyisms applied to ChatGPT is really going to protect anyone, so I would appreciate if you could elaborate on this.

One way which has someone been proven is, that through lowering the barrier to entry for writing software it has lowered the barrier to entry for writing malicious software, because malicious software is a kind of software. But the list of things that have lowered the barrier to entry for writing software is staggering, and to me ChatGPT is really just an increment on this. It may be a big and significant increment, but not as big as everything that preceded it in my view, so if we are to assign blame fairly, then most of it does not go to ChatGPT.

Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by phonebucket on Thursday January 19, 2023 @03:03AM (#34437861)
One example off the top of my head: what if ChatGPT was used to automate large scale personalised scamming?
Re:Meet “Claude”: Anthropic’s Rival to ChatGPT by otabdeveloper4 on Wednesday January 18, 2023 @07:17AM (#34425827)
But ChatGPT might exhibit wrongthink tendencies, that would be plus-ungood.