Re:Large language models generate functional protein sequenc...
by tomohelix on Saturday May 13, 2023 @11:18PM
(#35935042)
I think English is also just the rehash of the same 2000-3000 words. The ability to meaningfully arrange those words in new ways and in longer sentences are what make the current LLMs so powerful. In that way, these protein models can still learn more from the current data but they will definitely need some sort of reinforcement learning and grounding. That is where wetlab scientists will have to do. Verifying the generated protein is functional and stable, i.e. "making sense", is where we lack data.
Only a miniscule amount of protein has verified structure an function. While an HMM can predict their function pretty well based on homology, it isn't guaranteed. Having that kind of noise in the training data can degrade the performance of these protein models. Perhaps we need better curated dataset before we can scale these up.
Only a miniscule amount of protein has verified structure an function. While an HMM can predict their function pretty well based on homology, it isn't guaranteed. Having that kind of noise in the training data can degrade the performance of these protein models. Perhaps we need better curated dataset before we can scale these up.