Re:Large language models generate functional protein sequenc...
by seydor on Sunday May 14, 2023 @02:02AM
(#35935694)
It would be super interesting if we figure out that everything in life including language are fractals of molecular biology
Re:Large language models generate functional protein sequenc...
by throwawaymaths on Sunday May 14, 2023 @03:22AM
(#35936062)
This is like saying it would be interesting if we figure out that everything in the universe including physics, biology and consciousness is fractals of OEIS
Transformer trained on human genomes, learns to identify different genomic elements like enhancers without knowing what enhancers are https://www.biorxiv.org/content/10.1101/2023.01.11.523679v2
Similarly, a transformer trained on only plant genomes 'knows' how the strength of genomic variants' impact https://www.biorxiv.org/content/10.1101/2022.08.22.504706v2
Lots of experiments happening around GPT-4 too;
Using regular GPT-4 to curate cell type annotations https://www.biorxiv.org/content/10.1101/2023.04.16.537094v1
Testing GPT-4 across a variety of 'standard' tasks like linking gene IDs to protein IDs https://www.biorxiv.org/content/10.1101/2023.03.11.532238v1