From my experience in research, pharma has found that cellular models and phenotypic assays are far more meaningful for pushing projects forward. So, there is far more interest in applying machine learning to that data than for building protein structures. And those same methods can be applied to target-based projects regardless of whether you have structure. And regardless of how flexible your protein is. Huge portions of structure-based modeling has no ability to deal with protein flexibility, even if you know there are open and closed conformations of the protein or a loop that adopts half a dozen configurations.
Basically, academics working on folding often believe far too much in the importance of structure in drug discovery. The author appears to fall into that category.
They seem to acknowledge this:
The above graph is misleading in one way though because it is dependent on a specific metric, GDT_TS, which only measures gross topology. If we care about high resolution topology, which we certainly do for most practical applications, then a more appropriate metric is GDT_HA, and using it the picture looks a bit different:
[graph]
Still a good trendline, but much further down from a “solution”.
Another caveat is that both of these metrics measure global goodness of fit, which is important in terms of the basic scientific problem, but is often not indicative of functional utility. Local accuracy, for example the coordination of atoms in an active site or the localized change of conformation due to a mutation, is what is often sought when answering broader biological questions. Global metrics hide local discrepancy by diluting it in the sea of generally good agreement between experimental and predicted structures.
and
Even for MSA / family-level predictions, there is the question of desired accuracy, which hinges on the biological application. If one is predicting protein structures to ascertain their general fold for function classification, then high accuracy is unnecessary. If on the other hand the objective is to design small molecule drugs that bind proteins, which require ~1Å accuracy in the local pocket, it is unclear if we have made any detectable progress.
Cowsandmilks points out the limit of AlphaProtein above: https://news.ycombinator.com/item?id=18647187
The problem is one runs out of reasonably isolated problems with a reasonable metric.
I would have preferred that text in the comment you responded to had less of a trash talking feel to it.
Also it’s a bit overplayed because although these are special moments, there’s no shortage of examples in history where a new approach in one field is applied to get results previously unattainable in another.
However there’s no need for rationalizations. The result doesn’t generalize to anyone is smarter than anyone else, or that it’s not important because it’s not the super most important drug discovery tool.
It’s just a special moment where a technique is impacting another area of research. Which is part of a special period in history where AI/ML is evolving from being literally a joke that could defund your research, to finally having a broad set of useful applications.
We should be glad to see as many of these moments as possible from any discipline to any other.
It reminds me of the 90's and early 2000's when many were convinced that sequencing the human genome would suddenly make drug discovery a simple problem.
In a pharma setting, the 3D structure of a protein is mostly used to perform drug design (https://en.wikipedia.org/wiki/Drug_design#Computer-aided_dru...), i.e. trying to understand how a chemical will physically interact with a protein and thereby modify it's physiological function, in order to treat a disease.
The biggest problem comes from the fact that proteins are (1) non-static and very flexible and (2) don't exist in vacuum, they interact with a myriad of other entities in a living system. In other words, it's not because you know the structure of a protein and how to theoretically perturb it with a small molecule, that you have a drug. The large majority of structures predicted to be active against a protein target are not, when tested in a biological assay. The process helps, but ultimately it's a very empirical endeavor (test a ton of different chemicals in actual experiments, try to abstract some logic and move on from that). As a result, simply knowing the structure of a protein will not get you far down the line into finding a new drug.
On the resource topic: Even in a very large pharma setting, you will find only a dozen of scientists or so dedicated to the topic (out of tens of thousands employees), supporting many projects and with very little time to perform their own research. As a result, any team fully dedicated to the problem (like AlphaFold) can easily over-compete pharma. Most of the cost in drug discovery comes from dealing with patients and clinical trial. It's only at this stage that you'll know how your drug really works, and how it fits in the existing market and society (think of neuroscience for instance).
I don't want to undermine the protein structure field and AlphaFold results (it's fascinating), but pharma business model de facto relies very little on knowing a protein structure or not. It's also mostly useful to design small molecules, a class a bit out of fashion (biologics are the top-sellers in 2018, and new modalities are coming-up, like RNAs and gene editing for instance).
This is true, and big pharma will continue to invest very heavily here, since these medications contain living organisms and are much harder/more expensive to make into "generic" versions.
What this essentially comes down to is a bunch of teams with high domain expertise and high technical capability was beaten by a team with higher comparative technical capability and lower comparative domain expertise. One has to wonder if one of the teams with higher domain expertise (ie work in the field every day) could achieve better results by improving their technical capabilities, or more aggressively applying their domain knowledge.
The question really comes down to whether DeepMind can beat any hard "game" (chess, go, protein folding etc) better than humans with deep domain expertise.
The fact that the experts are entrenched in departmental trench wars and crippled by bureaucratic crap on every step is probably a contributing factor. If they were free to advance actual research instead of contributing to some middle manager's manager's agenda, thinks might look different.
If they don't invest in R+D it's a choice.
Now that Alphabet has sown them a better way, money should pour into the new technique.
If you read OP, AlphaFold's main innovation is predicting distance instead of contact (regression instead of binary classification), which was also independently developed by Xu, and further, using probability distribution over distance instead of simply choosing the best distance.
Let's see how pharmaceutical companies are dealing with that, or the next fields DeepMind will enter and shake up like that.
There’s a lot of value near the end of the development cycle, and not near the start.
(I conclude from this that there remains a role for government in directly funding scientific research.)
In industry, often we have structures of related proteins, giving a couple advantages:
Template-based modeling is feasible, a category that AlphaFold didn't win because they didn't use templates; using templates gives better structure prediction than what their free modeling can do.
Crystallography conditions are often similar between related proteins and techniques such as molecular replacement make it so we can solve the phasing problem easily, which is often a roadblock as well in academia.
I wonder, is this because these methods are simply 'not good enough' to really have an application for medicine yet? I know nothing of the pharmaceutical sector, but saying they don't do basic research seems to stretch my world view given their vast profit baselines and government funding for exactly that purpose. Is there someone in the field who knows more?