Re:Pretraining on the Test Set Is All You Need
by gwern on Saturday October 28, 2023 @03:37PM
(#38052723)
There are 'canary tokens' that you can add to your dataset which are supposed to be respected by self-regulating scrapers & responsible ML practitioners to grep them out before doing any training. How well it works is unknown, of course...
[ Parent
| on HN ]
There are no comments on this comment yet.