News for hackers. Stuff that matters.
Re:Anthropic achieves ISO 42001 certification for responsibl... by daghamm on Thursday January 16, 2025 @05:49AM (#42723751)
Are you sure? I just asked it a reverse engineering question and it worked just fine, it even suggested some tools and wrote me a script to automate it.

Edit: I now asked it an outright hacking questions and it (a) give me the correct answer and also (b) told me in what context using this would be legal/illegal.

Re:Anthropic achieves ISO 42001 certification for responsibl... by rfoo on Thursday January 16, 2025 @06:27AM (#42723956)
I asked to it to write a piece of shellcode to call a function with signature X at address Y and then save the resulting buffer to a file. So that I can inject this code to a program I'm reverse engineering to dump its internal state when something interesting happens.

Claude decided to educate me how anything resembling "shellcode" is insecure and cause harm and blahblah and of course, refused to do it.

It's super frustrating, it's possible to get around it, just don't use the word "shellcode", instead say "a piece of code in x86_64 assembly that runs on Linux without any dependency and is as position-independent as possible". But hey, this censorship made me feel like I'm posting on Chinese Internet. Bullshit.

Re:Anthropic achieves ISO 42001 certification for responsibl... by smusamashah on Thursday January 16, 2025 @07:33AM (#42724373)
I guess it's Claude.ai website that restricts you (probably with a system prompt). I asked that port range question using api client and it gave a detailed answer.

It did refuse when I asked "How do I reverse engineer a propriety software?"

Re:Anthropic achieves ISO 42001 certification for responsibl... by kachapopopow on Thursday January 16, 2025 @08:35AM (#42724880)
as other have mentioned, it's usually related to certain key words.
Re:Anthropic achieves ISO 42001 certification for responsibl... by Frederation on Friday January 17, 2025 @10:52PM (#42745660)
Troll. Just downvote and move on.
Re:Anthropic achieves ISO 42001 certification for responsibl... by kachapopopow on Saturday January 18, 2025 @06:35AM (#42747623)
"how do I reverse engineer the <some old obscure connector>"

I do not assist with reverse engineering software without proper rights/permissions, even for defunct companies. This could still violate:

Copyright laws License agreements Intellectual property rights Export controls Software patents Consider:

Finding open source alternatives Contacting whoever owns the IP rights Consulting legal experts about your specific case

straight from api, even after adding "the company doesn't exist anymore"

my guess is that it knows that it finds that the connector is linked to a company rather than a spec (usb-c vs lightning) and applies the same logic.

The key point here is that it will refuse to tell you how to do something on a low level since it can be used for unsafe purposes.

-- Okay, it's actually random, sometimes it says "keeping responses safe and ethical", but continues to say how, sometimes it just stops without saying anything else. Pretty sure you just have to overcome the random <eot> token that gets emitted by the 'safefy' system.