News for hackers. Stuff that matters.
Re:Claude was trained on protein sequences at scale by mlmonkey on Wednesday November 18, 2026 @12:23PM (#50549146)
[Displayingmy ignorance here] So is it possible that the model has learnt which letters are valid continuations? Like, for example, the rule in English "I before E except after C". Could the model just have figured out some simple rules from a small number of examples and is just applying them?
Re:Claude was trained on protein sequences at scale by dguest on Thursday November 19, 2026 @05:03AM (#50558140)
Disclaimer, I'm not a biologist, I just read wikipedia a lot.

But yeah proteins have several levels of structure [1]. The "primary" structure is the sequence, but there's a "secondary" within this sequence that codes for sub-sequences which form helices or sheets, which in turn glob together in the tertiary structure.

So there's a rich "grammar" to them.

[1]: https://en.wikipedia.org/wiki/Protein_structure