News for hackers. Stuff that matters.
Re:Show HN: The largest collection of ChatGPT jailbreaks on ... by CSMastermind on Wednesday March 01, 2023 @02:55AM (#34979844)
https://arxiv.org/pdf/2005.14165.pdf

WebText and WebText2 referenced in their papers are corpuses based on Reddit submissions which had a 22% weight in their training model.

https://openwebtext2.readthedocs.io/en/latest/

This is larger than Wikipedia (3% weight) or either of their two book corpuses (8% each).

The only other data included was a filtered set from Common Crawl (weighted 60%).

There are no comments on this comment yet.