News for hackers. Stuff that matters.
Re:Claude was trained on protein sequences at scale by mlmonkey on Wednesday November 18, 2026 @11:31AM (#50548346)
Does shuffling still result in a viable protein? I'm no biochemist, so this is a naive question. Do proteins have some (chemical) constraints on how the "letters" can be arranged?
Re:Claude was trained on protein sequences at scale by dguest on Wednesday November 18, 2026 @11:49AM (#50548606)
Shuffling still gives you a viable amino acid sequence but it might fold up into garbage or just fall apart.

Real proteins have a number of structures which are composed from sequences and which make up the larger functional proteins. In the extreme case if you have a good idea what the protein does and an unprecedented way to predict its folding you could probably guess most of the sequence having never seen it.

You can think of it as computer code. It's a terribly written language that does no static checking or error handling, and in which every conceivable hack is used. But since many proteins do similar things they also reuse the same substructure.

Re:Claude was trained on protein sequences at scale by mlmonkey on Wednesday November 18, 2026 @12:23PM (#50549146)
[Displayingmy ignorance here] So is it possible that the model has learnt which letters are valid continuations? Like, for example, the rule in English "I before E except after C". Could the model just have figured out some simple rules from a small number of examples and is just applying them?
Re:Claude was trained on protein sequences at scale by dguest on Thursday November 19, 2026 @05:03AM (#50558140)
Disclaimer, I'm not a biologist, I just read wikipedia a lot.

But yeah proteins have several levels of structure [1]. The "primary" structure is the sequence, but there's a "secondary" within this sequence that codes for sub-sequences which form helices or sheets, which in turn glob together in the tertiary structure.

So there's a rich "grammar" to them.

[1]: https://en.wikipedia.org/wiki/Protein_structure