Perhaps it is a bad thing that the leading AI companies cannot control their AIs

Re:Perhaps it is a bad thing that the leading AI companies c... by CarrieLab on Monday December 12, 2022 @09:03PM (#33963707)

I'm a PM at a human data company (https://www.surgehq.ai) that helps the large language model companies ensure their models are safe (we're the “clever prompt engineers” who helped Redwood assess their model performance).

We actually just published a blog today that includes our perspective on building “AI red teams” and best practices for AI alignment/safety: https://www.surgehq.ai/blog/ai-red-teams-for-adversarial-tra...

[ Parent | on HN ]

Re:Perhaps it is a bad thing that the leading AI companies c... by nomel on Tuesday December 13, 2022 @03:24AM (#33966145)

> helps the large language model companies ensure their models are safe

Here's the Merriam-Webster definition for the word you're using:

    ensure : to make sure, certain, or safe : GUARANTEE

"ensure their models are safe" suggests you're claiming that you're using the "certain" definition, and that you can, for certain (which requires proof) guarantee safety of an LLM?

[ Parent | on HN ]