News for hackers. Stuff that matters.
Re:Pretraining on the Test Set Is All You Need by gwern on Saturday October 28, 2023 @03:37PM (#38052723)
There are 'canary tokens' that you can add to your dataset which are supposed to be respected by self-regulating scrapers & responsible ML practitioners to grep them out before doing any training. How well it works is unknown, of course...

There are no comments on this comment yet.