News for hackers. Stuff that matters.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by harperlee on Monday November 30, 2020 @11:06AM (#25255193)
Not knowing a lot about biotechnology, I read the article and it sounds great, but how big is this as a gamechanger? Can someone comment on how big are the implications of this in, let’s say, 5 years from now, on day to day life? Does this mean that biotech is going to explode? Or just that drugs will come to market faster, perhaps cheaper for rare diseases, but from the same industry structure as always?
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by fabian2k on Monday November 30, 2020 @11:15AM (#25255304)
Protein folding is a big and important problem, so this is certainly big news if it works as well as it seems. But I wouldn't assume that this changes everything, we can already determine how proteins fold by experimental work. The disadvantage is that this is a lot of work, though the methods there also improved a lot.

One question is how robust the predictions are that DeepMind produces. I would also assume that right now it can't e.g. determine protein structures in the present of other small molecules, or protein complexes. A lot of the interesting stuff lies in the interactions between molecules.

And in general in life sciences any new development will take at least a decade until it hits day to day life, likely even more. We're living with a exception to this rule right now due to the pandemic, but in general things take quite a bit of time in that space.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by derefr on Monday November 30, 2020 @11:20AM (#25255384)
We can already determine how a few proteins (170k — which sounds like a lot, but which is only 0.09% of all currently-catalogued protein sequences) fold by experimental work.

What an accurate model of protein folding allows us to do, is to take our big database of DNA, predict protein foldings for all of it, and then stand up a search index for this database, keying each amino-acid "row" by the "words" of its predicted protein's structural features.

We could then, with a simple search query that executes in O(log n) time, find DNA targets that produce molecules with interesting structures that might be worthy of study.

This would, for example, be a game-changer in how biopharmaceutical macromolecule-therapy R&D is conducted. Right now we have to notice that some bacterium or another produces some interesting protein, and then engineer a bioreactor to get more of that protein. With this tech, we can work backward from an entirely hyothetical, under-specified "interesting protein", to figure out what catalogued-but-unstudied DNA sequences produce never-before-catalogued proteins that fit that particular functional "shape", and therefore might do the interesting thing. Then we can either directly synthesize that same DNA, or find the organism we originally sampled it from and study it more.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by fabian2k on Monday November 30, 2020 @11:27AM (#25255473)
"A few" does appear quite dismissive of the enormous amounts of effort in structural biology so far. There are more than 170,000 structures in the PDB right now.

To determine potential targets for drugs we have to understand what the proteins do. Having the structure is not really enough for that, it doesn't tell you the purpose of the protein (though it certainly can give you some hints).

In most cases the proteins were determined to be interesting by other experiments, and then people decided to try and solve their structure. So the structures we already solved are also biased towards the more biologically relevant proteins.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by derefr on Monday November 30, 2020 @11:36AM (#25255601)
170k is "a few" compared to 180 million (i.e. the size of the PDB as soon as someone runs AlphaFold over everything in the UniProt.)

> In most cases the proteins were determined to be interesting by other experiments, and then people decided to try and solve their structure.

Yes, that's what we're doing right now, because structure is not a useful predictor, because we don't have structure available in advance of studies on the protein itself. There was no point to a "functional taxonomy" of proteins, because we were never trying to predict with protein-structure as the only data available.

In a world where protein structure is "on tap" in a data warehouse, part of the game of bioinformatics will become "structural analysis" of classes of known-function proteins, to find functional sub-units that do similar things among all studied proteins, allowing searches to be conducted for other proteins that express similar functional sub-units.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by fabian2k on Monday November 30, 2020 @11:43AM (#25255717)
Determining what a protein structure does might be even harder than folding. Right now we can't really do that ab initio, you have determine the activity in the lab and then look at the structure. And that allows you to potentially identify this motif in other proteins.

If someone produces an AI that you give a sequence and it tells you what the protein does exactly, I'd be extremely impressed. I don't see that happening soon.

The specifics matter a lot here. We can often determine rough functions for subdomains by homology alone. But that really doesn't tell you the full story, it only gives you some hints on what that protein actually does.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by jeffxtreme on Monday November 30, 2020 @03:28PM (#25258538)
Five years ago, I would have said the following:

"If someone produces an AI that you give a sequence and it tells you the protein conformation, I'd be extremely impressed".

Sure there are many more things to solve in this space; but that doesn't take away that this is an impressive achievement and does unlock quite a few things (including making more tractable the problem you just brought up). I'm excited to see what DeepMind works on now and what the new state of the world will be just five years from now.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by fabian2k on Monday November 30, 2020 @03:58PM (#25258881)
I think I have to clarify that my response was to a large part to the "this will change all our lives" part, and might look too negative on its own. I'm very, very impressed by these results, but that still doesn't mean that we just solved biology. If this works that well on folding, this could mean that a lot of other stuff that simply didn't work well in silico might come into reach.

I'm maybe overcompensating for the tech-centric population here, with some comments speculating for very near and drastic impacts from discoveries like this. Biology and life sciences are much slower, and there's always more complexity below every breakthrough. That does tend to push me towards commenting with the more skeptical and sober view here.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by whatshisface on Monday November 30, 2020 @11:59AM (#25255933)
My understanding of this is not perfect, but wouldn't answering the "actually does" question require a full biomolecular model of the cell, or even the whole organism? If so I see what you mean. I suppose that it might be possible to get around this by improving the theory of catalysts so that you could look at a site and say, "oh, this will act in such a way..." Dynamic quantum simulation of a few atoms at the active site is hardly easy but a far sight easier than the other.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by Rochus on Monday November 30, 2020 @11:42AM (#25255695)
It's a step forward for sure, but structures change over time to perform their function. The method described here only returns a static structure. Much more research and development is needed to be able to predict the dynamic behavior and interplay with other proteins or RNA.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by AlexCoventry on Monday November 30, 2020 @04:11PM (#25259035)
> as soon as someone runs AlphaFold over everything in the UniProt

It'll take a while before those results can be trusted, though, right? There's probably a selection bias in the training data for proteins which are easy to crystallize, so many proteins probably aren't well represented by the training examples.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by entropicdrifter on Monday November 30, 2020 @11:34AM (#25255566)
170,000 is three orders of magnitude less than the number of recorded protein sequences. I don't think it's dismissive to describe that as comparatively few.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by flobosg on Monday November 30, 2020 @12:02PM (#25255963)
Structure is much, much more conserved than sequence. In other words, protein sequences with low sequence identity can fold similarly due to the physical constraints that guide protein folding.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by ClumsyPilot on Monday November 30, 2020 @11:40AM (#25255675)
I don't know the field, and I understood 'a few' as like a dozen, certainly not in the thousands.

Anyone uninitiated with think the same, and thise already informed. Well, they are already informed.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by ALittleLight on Monday November 30, 2020 @01:29PM (#25257134)
I also don't know the field and the opposite concern is that 170,000 sounds like a lot, but, apparently, it's a relatively small amount compared to the number of proteins there are. It makes sense to me to refer to it as a small number - e.g. "That hard drive is tiny." "No, it stores several million bytes..."
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by btilly on Monday November 30, 2020 @12:57PM (#25256709)
We can already determine how a few proteins fold by experimental work.

Where "a few" is around 0.1% of the known 180 million proteins. So a relative few and a whole lot.

But the catch is which proteins could we figure out by experiment, and which not. In particular membrane proteins are hard to experimentally determine. But knowing how they fold is very important for figuring out how to get things to react with or get through membranes such as cell walls. Which is an important problem for everything from understanding how viruses work to targeted delivery of drugs. We now have a way to find those structures.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by FredFS456 on Monday November 30, 2020 @05:39PM (#25259964)
There are post-translational modifications to proteins. This means that for many (most?) proteins, the amino acid chain sequence is different from what you would predict from the DNA. These modifications are dependent on the state of the cell at the time of translation, and so cannot be predicted from the DNA alone. Even with a 100% accurate folding model, we cannot simply know the shapes of all the proteins inside the human body based on the genome.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by carlob on Monday November 30, 2020 @11:40AM (#25255673)
Here is another interesting approach in synthetic protein building:

https://science.sciencemag.org/content/369/6502/440.abstract

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by ghostpepper on Monday November 30, 2020 @11:27AM (#25255476)
This does indeed sound like a game changer then, if true
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by IgniteTheSun on Monday November 30, 2020 @11:30AM (#25255518)
Considering that this system "uses approximately 128 TPUv3 cores (roughly equivalent to ~100-200 GPUs) run over a few weeks" to determine a single protein structure, making predictions for all proteins encoded in a human genome seems impractical at this stage. With luck, this advance will help lead to discovery and definition of new folding rules and optimizations that will make protein folding predictions for the whole human genome more tractable.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by mrDmrTmrJ on Monday November 30, 2020 @12:06PM (#25256031)
I think it is possible to make predictions for all proteins encoded in the human genome. Perhaps you misread a very long and confusing sentence?

Background, Neural networks have two modes 1) training - where you learn all the model weights and 2) inference - where you run the model once on new data. Training takes takes a long time, because you're computing derivatives to implement updates rules on millions or billions of parameters based on iteratively examining massive datasets. Inference is extremely fast because you're just running matrix multiplies of those parameters on new data. And TPUs/GPUs are specially designed to compute matrix multiplies.

The article said: "We trained this system [...] over a few weeks." I searched for, but did not see them identify the inference time. I do expect inference time to be well under one second, though I'm not personally experienced with running inference on this type of network architecture.

For comparison, GPT-3 and AlphaStar have month long training times and real-time (sub-second) inference times.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by sanxiyn on Monday November 30, 2020 @11:36AM (#25255603)
That's training time, not inference time.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by foota on Monday November 30, 2020 @11:38AM (#25255635)
My reading based on context was that this was time to train, not time to predict.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by Rochus on Monday November 30, 2020 @12:09PM (#25256077)
Still much faster than synthesizing the protein and then doing NMR or cristallography to solve the structure puzzle what easily takes half a year or more (and very expensive equipment).
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by gulperxcx on Monday November 30, 2020 @12:51PM (#25256616)
but how would this affect day to day life, though? Not how long you think it will.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by ampdepolymerase on Monday November 30, 2020 @09:06PM (#25261484)
Entire classes of diseases may become history. Creutzfeldt-Jakob and other prion diseases can now be completely understood. Precision targeting of cancerous cells will become trivial (in theory). Minimal life projects (simplest cell possible) will require less trial and error. In general, it will provide a magnitude level improvement to biotechnology, akin to moving from Aristotelian physics to Newtonian.

Some possibilities: artificial muscles for robots, man-made blood substitutes, designer enzymes to break down plastic and other compounds. Software defined biology, where the pipeline from DNA code to actual protein can now be modeled in silico ahead of time. The biology classes of the future may be less observation of animals and more training in usage of whatever the equivalent of Autodesk for biology will be. Healthcare economics in developing nations will be changed as biochemistry itself may finally become deterministic (to some extent). Orphan drug development price would drop (and if you take into account right to try laws and ignore ethics in favor of progress, then people with rare disease may be cured en masse without bankrupting the health insurance company).

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by comicjk on Monday November 30, 2020 @11:48AM (#25255789)
The most accurate technique in computational drug discovery is protein-ligand binding prediction (https://blogs.sciencemag.org/pipeline/archives/2015/02/23/is...). Given the protein structure, you can predict which molecules will bind with it, even for molecules which have never been sythesized. Many protein targets have not been amenable to this because we don't know what the potential binding pockets look like. That set of proteins will now drastically shrink. We're going to have a lot of new drug candidates, and with any luck new drugs, come out of this.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by breck on Monday November 30, 2020 @11:21AM (#25255389)
I never worked directly with protein folding or structure, but worked a bit in proteomics on teams measuring gene expression (which you could roughly think of as how much of each protein is found in this cell). IIRC there are 50,000 - potentially millions of "kinds" of proteins found in a human, and the "shape" of most of them is unknown, and that determines a lot about how they work.

So imagine you gave an iPhone to someone in the 1800's, they wouldn't understand how most of it works, but this may be analogous to them finally figuring out some key aspects of the transistor. So it's another tool in the toolbelt and like all good tools will be used in all sorts of unpredictable ways.

Someone else I'm sure could do a lot better at explaining how important shape is to understanding the function and behavior of proteins.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by shoguning on Monday November 30, 2020 @12:48PM (#25256575)
IMO, this is huge. One of the biggest applications of ML to science that I know of for sure. People used to manually crystallize proteins at great effort to solve for structures.

Of course, there is a caveat. The static, crystallized structure is only one aspect of a protein. The dynamic behavior dissolved in H2O, at different pH, different ionic strength, with different ligands/cofactors are all also important, and not (afaik) directly addressed by this research.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by _RPL5_ on Monday November 30, 2020 @02:45PM (#25258049)
The industry process will not change. You still need industrial biologists to generate and validate AphaFold structures, interpret the results as part of the bigger picture, and to finally design the drugs. And, then, of course you still need to validate the drugs in experimental systems (first the test tube, then mice, then humans).

So your second guess is correct - one of the steps is much cheaper now, which marginally improves the entire pipeline. As a result, drugs should now arrive to the market faster.

As a side note, I am curious what happens to the field of structural biology in 10 to 15 years from now. Every research university has a large structural biology department with super expensive Xray/NRM/Cryo-EM machines, and armies of students who routinely spend 4-6 years of their PhD trying to solve a structure of a single protein. If AlphaFold works as advertised, NIH will gradually shift funding to other problems.

(It was predicted that it'd be taxi drivers, not professors, that AI got first. Ironic.)

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by dalke on Monday November 30, 2020 @03:20PM (#25258436)
> "armies of students who routinely spend 4-6 years of their PhD trying to solve a structure of a single protein"

Back in the 1990s, when I worked on structure data, I remember that at least some crystallizations were easy enough they could be done as a rotation project.

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6287266/ suggests that life is now a lot easier than the 1990s. Quoting the abstract:

> Macromolecular crystallography evolved enormously from the pioneering days, when structures were solved by “wizards” performing all complicated procedures almost by hand. In the current situation crystal structures of large systems can be often solved very effectively by various powerful automatic programs in days or hours, or even minutes. Such progress is to a large extent coupled to the advances in many other fields, such as genetic engineering, computer technology, availability of synchrotron beam lines and many other techniques, creating the highly interdisciplinary science of macromolecular crystallography. Due to this unprecedented success crystallography is often treated as one of the analytical methods and practiced by researchers interested in structures of macromolecules, but not highly competent in the procedures involved in the process of structure determination.

Certainly some proteins are extremely hard to crystallize, and the new single-atom EM work will help a lot. But are there really "armies of students who routinely spend 4-6 years of their PhD trying to solve a structure of a single protein" these days?

I honestly don't know. I'm sure some do. But if so, that army is pretty small compared to the vast numbers who more routinely use crystallography.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by prcrthr on Tuesday December 01, 2020 @01:28AM (#25262934)
I had a friend who solved the structure of 2 or 3 new proteins pretty much by himself his senior year of college. I also had an acquaintance who was a PhD student in the same lab, who said (jokingly) that she hated him because she had spent 5 years on a single protein and got way worse results than he did. I got the sense from talking to them that the process of figuring out how to get a protein to crystallize is basically just trial and error over and over—my friend himself said he basically got very lucky several times in a row (though he is also a brilliant biochemist).

Anyway that anecdote is pretty much the entire sum of my protein crystallography knowledge, but perhaps it explains how your experience and GP's statement can both be true?

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by t_serpico on Monday November 30, 2020 @03:47PM (#25258759)
Also, one important thing to realize is that AlphaFold was trained largely on proteins that we were able to crystallize. I'd be very curious to see how its performance fares as a function of 'ease of crystallization'.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by _RPL5_ on Monday November 30, 2020 @05:21PM (#25259790)
You aren't wrong. I got caught up making the comparison between structural biologists and taxi drivers being ran out of business by AI, so I ended up exaggerating the work load that's addressed by AlphaFold. I should been more precise.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by nabla9 on Monday November 30, 2020 @12:07PM (#25256042)
Getting from DNA structure from tissue samples is relatively straight forward. DNA -> RNA -> unfolded protein is basically one-to-one mapping in most cases. How protein functions depends on how it folds into itself. Once you solve protein folding, you can take DNA sample and see the structure of the molecule without working in lab using crystallography techniques.

Solving protein folding is huge, Nobel in chemistry scale achievement. It would be massive leap for biochemistry.

It seems that Deep Mind solved competition benchmark and made huge leap, but it's just partial solution that works on limited set.

After you have solved protein folding, there is still problem of solving chemical interactions between molecules accurately. Quantum chemistry is extremely compute intensive.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by ivalm on Monday November 30, 2020 @12:21PM (#25256227)
This is still for proteins that fold without chaperons, but I guess it does cover a lot.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by dekhn on Monday November 30, 2020 @11:30AM (#25255516)
It seems unlikely there will be any large changes in life from solving protein folding. Knowing the structure of a protein (or really, its dynamics) is useful for identifying drugs that bind, but the real bottlenecks n drug discovery and biotech are elsewhere.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by ramraj07 on Monday November 30, 2020 @12:27PM (#25256308)
If folding and docking, alongwith dynamics simulations, start getting commodified, that might change things significantly though. I can already start imagining project workflows that are significantly streamlined without much thought, god knows what other scientists would dream up when we reach those steps
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by baybal2 on Monday November 30, 2020 @12:52PM (#25256631)
One young lady I knew worked on neural algos recognition of X-ray images.

They always had single digit, bizarre artifacts, where the program can't sometimes recognise the very data it was trained on with most minute differences.

Other artifact was that the most "stereotypical cases" were least reliably recognised, and they hot a lot of flak for screwed up live demos, where a radiologist put a very, very obvious tumor shot onto the scanner, and it didn't work without a half an hour of wiggling the film, and a camera.

The "bruteforce" solution may well be always, 80-85% off, but off consistently, and always. NN algo so far beat them, but fail with double digit frequencies on "artifacts" which they themselves can't do anything about.

How well it deals with the later, is what I believe will measure its real world usefullness.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by klmadfejno on Monday November 30, 2020 @03:12PM (#25258347)
I find this disingenuous. Yes, its important that the algos can perform well on real world data, but the framing of this post begins with an anecodote about one person who had a bad model, and implicitly extrapolates that these problems are generalized throughout all neural nets.

One could say the same thing about programmers automating a task, or a number of other trivial examples. I would lean towards assuming deep mind has competent model validation teams vs. not, even if data science is hard.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by tuatoru on Monday November 30, 2020 @01:17PM (#25256977)
I agree. The failures have to be explicable if we are to trust a model.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by asah on Monday November 30, 2020 @02:33PM (#25257890)
Doesn't it depends on the application ? i.e. some applications can tolerate false positives/negatives ?
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by baybal2 on Monday November 30, 2020 @03:03PM (#25258235)
May well be, but if you spend more compute, and human time checking for those corner cases than if you went with another, more consistent exhaustive search algorith, then the method looses to it economically.

This is more the case the more close to bruteforce you come, like encryption cracking. Imagine, spending years of HPC cluster time, trying to break a password, while knowing you have a single digit chance to miss the right key, in a way which would be completely impossible with with a conventional solution.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by candiodari on Monday November 30, 2020 @11:12AM (#25255262)
This will allow us to discover much more about the structure of the cell (of "life") at a before this unprecedented speed. We should find many, many more mechanisms and targets for medicine, but it takes 10-20 years to bring a new medicine to market.

So in 5 years you'll see exactly zero new medicines pop up.

Re:AlphaFold: a solution to a 50-year-old grand challenge in... by piyh on Monday November 30, 2020 @11:16AM (#25255316)
No new medicines, but way more biotech tools. Higher yield GMO plants, foundational research into disease, science backed recommendations for lifestyle changes to avoid disease that previously eluded us, some crazy stuff happening in animal models. The progress in biotech the past 20 years makes moore's law look slow.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by pmastela on Monday November 30, 2020 @02:27PM (#25257800)
I agree. The main inhibitor of speed that products of this advancement will be deployed at will likely be determined by local policies. Though, given just how profound some of the impacts on medicine might be, the speed at which they can be deployed might become a matter of national security (a healthier population bodes well for a healthier economy which in turn strengthens national security). Hopefully this competition shortens the time-to-market for all these new medicines.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by npunt on Monday November 30, 2020 @04:03PM (#25258936)
In short, a core problem of biochem (the wagon) was just hitched to Moore's law (the horse). Our understanding of proteins will now grow exponentially not linearly, helping us to move up a level of abstraction to higher level biochemistry and biology problems.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by xyzzyz on Monday November 30, 2020 @02:26PM (#25257783)
My friend, who is working in crystallization lab, has told me that she’s gonna be claiming unemployment soon, and she was only half joking.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by dalke on Monday November 30, 2020 @02:57PM (#25258157)
She can still work on complexes, binding modes, and engineered biomolecules (eg, protein–drug conjugates and antisense oligonucleotide dimers) where the training data isn't really there.