I used to do bioinformatics, although more of the structure side than sequence. Like an information or understanding, it depends on what outcome you want that might benefit from the skill.
I suppose that predicting the next amino acid in a sequence would be useful for, say, reconstructing a protein sequence from fragments. Or constructing evolutionary trees of sequences by predicting the common ancestors?
Linking to ML space, is this analogous to knowing the model's weights byheart ? Traditionally this has been not useful to humans and machines, but recently some LLMs have started showing capability to directly edit the model weights to alter the behavious of smaller models. Is that a completely wrong analogy ?
Also I guess what I am partly curious is on how this data ended up in the model. Was it part of the pretraining corpus or was there an RL environment which specifically rewarded this behaviour
How useful the predicted sequence is for the predicted structure - and predicted function - no idea! There are already several layers of prediction here.
Sorry, I definitely do not know enough about LLMs to understand the analogy to weights. You can predict the effects of mutations on sequences, I think? As in, if I change this Q to an E will it make the enzyme faster (??). Perhaps you could LLM-generate a plausible member of a family of enzymes with a particular function, given fragments of an existing protein (???).
No idea how the data got in the model. It seems like the study that Xinming and Chen have done was designed to eliminate sources from the general corpus of knowledge - like any old science papers - b choosing obscure and rare sequences that might only be found in a sequence db.
jokes apart I do hope the LLMs ability to being a master at multiple unrelated fields unlock valuable insights
On the data getting in the model - I suspect: as the models have gotten bigger, the labs have started including more info from sequence databases of some sort