Re:LLMs are too easy to automatically red team into toxicity
by red-iron-pine on Tuesday July 04, 2023 @01:04PM
(#36589459)
I've heard it as a verb for sure -- "I've been red-teaming at X Corp for a while now"
But in a broader sense it's oppositional actions taken against a "good guy", usually with the goal of improving the good guy aka the Blue Team.
Think Starcraft or other video games where you have a little radar in the corner; good guys are blue, bad guys are red.
In the context of cybersecurity, a "red team" refers to a group of individuals who simulate attacks or test the security of a system to identify vulnerabilities and weaknesses.
Then, is it a verb?
In the given headline, "red team" functions as a verb phrase. Specifically, "red team" is used as a verb in the infinitive form. The phrase "to automatically red team" indicates the action of assessing or evaluating LLMs for toxicity using automated methods.