News for hackers. Stuff that matters.
Re:No, DeepMind has not solved protein folding by kevinskii on Friday December 04, 2020 @02:28PM (#25306573)
Mohammed AlQuraishi elaborated on this in his 2018 "What Just Happened?" blog post that was discussed on HN when the news was announced. [1]

It's a fairly long read, but he goes into a lot more detail as to why the problem isn't yet solved. Interestingly, he also notes that pharma and academia should feel some embarrassment from DeepMind's achievement:

"What is worse than academic groups getting scooped by DeepMind? The fact that the collective powers of Novartis, Pfizer, etc, with their hundreds of thousands (~million?) of employees, let an industrial lab that is a complete outsider to the field, with virtually no prior molecular sciences experience, come in and thoroughly beat them on a problem that is, quite frankly, of far greater importance to pharmaceuticals than it is to Alphabet. It is an indictment of the laughable “basic research” groups of these companies, which pay lip service to fundamental science but focus myopically on target-driven research that they managed to so badly embarrass themselves in this episode."

[1] https://moalquraishi.wordpress.com/2018/12/09/alphafold-casp...

(Edited to clarify that the blog post was not recent.)

Re:No, DeepMind has not solved protein folding by CamelCaseName on Friday December 04, 2020 @02:41PM (#25306750)
That quote is from 2018.

Here is what Mohammed AlQuraishi said in 2020:

CASP14 #s just came out and they’re astounding—DeepMind looks to have solved protein structure prediction. Median GDT_TS went from 68.5 (CASP13) to 92.4!!!! Cf. their 2nd best CASP13 struct scored 92.8 (out of 100). Median RMSD is 2.1Å. I think it's over [0]

and

“I think it’s fair to say this will be very disruptive to the protein-structure-prediction field. I suspect many will leave the field as the core problem has arguably been solved,” he says. “It’s a breakthrough of the first order, certainly one of the most significant scientific results of my lifetime.” [1]

[0] https://twitter.com/MoAlQuraishi/status/1333383634649313280

[1] https://www.nature.com/articles/d41586-020-03348-4

Re:No, DeepMind has not solved protein folding by twic on Friday December 04, 2020 @08:11PM (#25310608)
I can't square this with the actual competition results. There are tons of targets where AlphaFold2 didn't score over 70%. It was typically only 10% ahead of the next best program. The metric everyone is looking at, GDT_TS, gives marks for atoms that are within eight angstroms of where they should be - by experimental standards, eight angstroms is a huge miss! There are targets where on some important metrics, like C-alpha RMSD, AlphaFold2 did worse than another program!
Re:No, DeepMind has not solved protein folding by refulgentis on Friday December 04, 2020 @09:15PM (#25311017)
You're making extremely strong claims, counter to scientists with no incentive to praise Google being quoted with reactions such as expecting a mass exodus from computational biology. I, and I assume we, are open to hearing more but I'm not sure cherry-picking a couple examples is enough to credit your claims contra theirs.

For instance, the gentlemen who was presented as a skeptic is instead shown to also say it's solved, and in reply to this you say "everyone" is looking at the "wrong" metric, and it allows errors of 8+ atom widths - he notes the median error is 2.1 angstroms, or 2.1 atom widths.

Re:No, DeepMind has not solved protein folding by byecomputer on Saturday December 05, 2020 @12:16AM (#25311984)
I feel like there's a certain je ne sais quoi to the comments Google employees write where I can just immediately sense them without even needing to check.
Re:No, DeepMind has not solved protein folding by sbergot on Saturday December 05, 2020 @03:35AM (#25312868)
You are not helping your case by calling out people based on where they work instead of what they say. Refulgentis is raising factual points.
Re:No, DeepMind has not solved protein folding by _Wintermute on Friday December 04, 2020 @02:48PM (#25306842)
Pharma companies don't feel any embarrassment because it's really not much of a priority for them. Protein structure determination simply isn’t a rate-limiting step in drug discovery in general. [1]

[1] https://blogs.sciencemag.org/pipeline/archives/2019/09/25/wh...

Re:No, DeepMind has not solved protein folding by dekhn on Friday December 04, 2020 @02:56PM (#25306940)
That is true but every pharma has a structural biology department that solves product-related crystal structures with the intent of using that data to speed development. It's an established thing, $100+M/year budget per company. Generally well-respected and considered some of the most important IP the company can generate.

They also have theory groups which try to do structure prediction and drug docking but I don't think those groups get any respect inside the companies any more.

Re:No, DeepMind has not solved protein folding by inopinatus on Friday December 04, 2020 @03:24PM (#25307334)
Counterpoint: no-one needs to feel any embarrassment. The advancement of human understanding is not a boxing match.

The author acknowledges as much in the preamble, "my mood lifted during the meeting due to the general excitement and quality of discussions, [...] my tribal reflexes gave way to a cooler and more rational assessment".

Re:No, DeepMind has not solved protein folding by stjohnswarts on Friday December 04, 2020 @06:23PM (#25309660)
Tell that to said company's stockholders and get their response :) . In the big picture though is new, correct knowledge is always welcome to the pool.
Re:No, DeepMind has not solved protein folding by zamadatix on Friday December 04, 2020 @02:44PM (#25306789)
I think it's arguably the exact opposite. It would have been surprising if medical companies had proven machine learning can model protein folding so much better before the world's leading AI research group could. The demonstration was one of machine learning research being applied to medical problems not medical research being applied to machine learning problems so DeepMind was the one with the head start on expertise.
Re:No, DeepMind has not solved protein folding by tachyonbeam on Friday December 04, 2020 @02:54PM (#25306920)
And let's not forget that deep learning started really exploding and becoming mainstream around 2015-2016. I'm not sure how you could expect someone like Pfizer to hire top experts and build a competitive lab in such a short time, particularly since, Pfizer would want these people to focus exclusively on biotech, which would not be that attractive to most deep learning researchers.
Re:No, DeepMind has not solved protein folding by nl on Friday December 04, 2020 @11:28PM (#25311752)
OpenAI was founded in Dec 2015. They have a smaller budget than Pfizer and work on less practical problems.

It's a lack of vision and leadership from pharma labs.

Re:No, DeepMind has not solved protein folding by tachyonbeam on Saturday December 05, 2020 @03:50PM (#25318201)
> It's a lack of vision and leadership from pharma labs.

That's probably true, but I don't think Pfizer could have beat DeepMind, even if they had really tried. DeepMind is in a unique position to recruit lots of young deep learning researchers.

Re:No, DeepMind has not solved protein folding by mhh__ on Friday December 04, 2020 @02:35PM (#25306658)
> The fact that the collective powers of Novartis, Pfizer, etc, with their hundreds of thousands (~million?) of employees

Deepmind have at least a few thousand employees, I'm willing to go out on a limb and say that the industry doesn't have "hundreds of thousands" of people working on protein folding alone.

Re:No, DeepMind has not solved protein folding by adtac on Friday December 04, 2020 @02:40PM (#25306736)
well, not everyone at DeepMind is working on protein folding either presumably (disclosure: I work at Google, but I know nothing about DeepMind other than whatever's public). I think the point they're making is that DeepMind has an order of magnitude or two fewer people working on this for a much shorter period of time than pharma companies.
Re:No, DeepMind has not solved protein folding by est31 on Friday December 04, 2020 @03:11PM (#25307130)
In the video on the announcement page, there was a short scene where they showed a Zoom call where the results were announced. I counted 20 people. The paper they published in Nature has 1 authors, so it matches up. Probably this is not the precise team size, but gives you a rough estimate.

What's important is I think which people they hired, as well as Deepmind-internal infrastructures. You can just walk over to one of the world experts in deep learning and ask them how to address some issue.

In pharma companies they have people who are really smart about drugs and biology, but ML experts would all have to be hired externally, and likely don't represent the top of the field as well as Deepmind does.

Re:No, DeepMind has not solved protein folding by tech-historian on Friday December 04, 2020 @03:21PM (#25307284)
Has Deepmind ever released how many employees it has? Several thousand seems much larger than I would have thought. Please cite your source on that.
Re:No, DeepMind has not solved protein folding by Permit on Friday December 04, 2020 @03:33PM (#25307464)
Here's a June 2020 article that says they have ~1,000 people: https://www.cnbc.com/2020/06/05/google-deepmind-alphago-buzz...
Re:No, DeepMind has not solved protein folding by kungito on Friday December 04, 2020 @04:02PM (#25307930)
At first it sounded like a lot but when I remembered by FAMANG org of similar size it's actually not that big. A 1000 people org probably nets you around 15-30 teams which have to include frontend, backend, infra, theory, experimental, internal tooling etc. I guess the biggest question is how many people in deepmind are sales/consulting etc. Do they have any external for profit contracts?
Re:No, DeepMind has not solved protein folding by woeirua on Friday December 04, 2020 @07:10PM (#25310112)
There’s the rub. Depending on who you ask DeepMind appears to, as of a year or two ago, be running deep in the red.
Re:No, DeepMind has not solved protein folding by nl on Friday December 04, 2020 @11:37PM (#25311788)
DeepMind will always be a loss center. That's what research groups are.

I don't know how UK R&D tax works, but most countries allow companies to write off some profits against R&D. Apart from the fact Google wants to do research, having a large center based in the UK probably helps their UK (and formerly EU?) tax position.

Re:No, DeepMind has not solved protein folding by Miraste on Friday December 04, 2020 @08:11PM (#25310607)
How would DeepMind get any revenue? I thought it was solely for research.
Re:No, DeepMind has not solved protein folding by jeremysalwen on Friday December 04, 2020 @02:36PM (#25306678)
This post is from 2018, when AlphaFold won the CASP competition, but nobody was claiming that it "solved" the problem, as you are now hearing in response to AlphaFold's performance at the 2020 competition.
Re:No, DeepMind has not solved protein folding by BHSPitMonkey on Friday December 04, 2020 @03:14PM (#25307166)
The same person who wrote said post in 2018 wrote about the 2020 AlphaFold results:

> CASP14 #s just came out and they’re astounding—DeepMind looks to have solved protein structure prediction. Median GDT_TS went from 68.5 (CASP13) to 92.4!!!! Cf. their 2nd best CASP13 struct scored 92.8 (out of 100). Median RMSD is 2.1Å. I think it's over

https://twitter.com/MoAlQuraishi/status/1333383634649313280

Re:No, DeepMind has not solved protein folding by CydeWeys on Friday December 04, 2020 @02:34PM (#25306637)
This blog post is two years old, whereas the linked blog post for this overall discussion is current.
Re:No, DeepMind has not solved protein folding by kevinskii on Friday December 04, 2020 @02:39PM (#25306713)
You're right, I should have pointed that out. I edited my original post to clarify. Thank you.
Re:No, DeepMind has not solved protein folding by sp332 on Friday December 04, 2020 @02:36PM (#25306667)
DeepMind's first entry into the competition was two years ago.
Re:No, DeepMind has not solved protein folding by SamBam on Friday December 04, 2020 @02:37PM (#25306693)
Right, so it's not exactly pertinent to whether the most recent work "solved" (for whatever definition of solved) protein folding.
Re:No, DeepMind has not solved protein folding by CydeWeys on Friday December 04, 2020 @03:05PM (#25307047)
And they have improved significantly in the two years since then, so many if not all of these criticisms that apply to their efforts from two years ago may now be out of date.
Re:No, DeepMind has not solved protein folding by hu3 on Friday December 04, 2020 @02:41PM (#25306741)
My impression is that DeepMind's performance have improved significantly since then.
Re:No, DeepMind has not solved protein folding by banjomet on Friday December 04, 2020 @02:58PM (#25306959)
I think it is also very embarrassing to IBM, which has been trying to get into healthcare with Watson.
Re:No, DeepMind has not solved protein folding by visarga on Saturday December 05, 2020 @02:57AM (#25312730)
I bet they are hiring BERT-ologists now.