yes https://github.com/randalltr/black-hat-ai/blob/main/README.m...

This is AI-written and while some of the methods might work, a lot of it is hallucinated and would not bypass any guardrails put together after 2023.

That is true, however that doesn't mean its worthless, some parts of it do work well against custom chatbots and things where the devs didn't do a good job on security, some of the methods even work against apples foundation models and non prime time consumer facing 1st party chat tools