News for hackers. Stuff that matters.
Re:OPT: Open Pre-trained Transformer Language Models by vladf on Wednesday May 04, 2022 @11:31AM (#31261893)
OK, this is a fun game. I think your counterattack assumes I'm picking these million weights uniformly randomly among the 175 billion. I modify my original answer: s/a million/half the weights in a deterministic subset of 2 million weights/

Select the deterministic subset by just hashing some identifier for each weight.

For any reasonable number of copies, there's a pretty unique subset between all your copies sharing a large amount of bits flipped in the same direction among this subset.

There are no comments on this comment yet.