News for hackers. Stuff that matters.
Re:Claude was trained on protein sequences at scale by octoberfranklin on Wednesday November 18, 2026 @10:11AM (#50547265)
But the signal seen on real sequences is much stronger than that

But the shuffled sequences aren't real sequences!

Sorry if I'm being daft here, but I still don't understand what the source of truth is for the shuffled sequence tests.

Re:Claude was trained on protein sequences at scale by wavemode on Wednesday November 18, 2026 @10:43AM (#50547697)
[delayed]
Re:Claude was trained on protein sequences at scale by octoberfranklin on Wednesday November 18, 2026 @01:13PM (#50549870)
Oh! So a lower score on the "shuffled" sequence is more validating of the experimental hypothesis.

I wish the article had stated this clearly. It seems to imply the opposite, which is of course false.