News for hackers. Stuff that matters.
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by Glavnokoman on Friday May 21, 2021 @09:36AM (#27233802)
"ALL the proposals that were intentionally vulnerable and were really vulnerabilities were not accepted" The thing is there is no way you can actually know that. So this is not some kind of revenge. This is rather a valid precaution.
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by Foxboron on Friday May 21, 2021 @09:51AM (#27233975)
>The thing is there is no way you can actually know that.

We do know since the researchers have told the linux community, the university and IEEE what those patches where. Please do not spread further misinformation about the case.

Please read the IEEE statement and the full Linux TAB review.

https://www.ieee-security.org/TC/SP2021/downloads/2021_PC_St...

https://lkml.org/lkml/2021/5/5/1244

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by atoav on Friday May 21, 2021 @10:01AM (#27234073)
Not trying to badmouth the university here, but having to trust the statement of those who broke your trust in the first place doesn't meet my definition of "knowing" something.

Maybe "believe" would be better used here? Knowing would mean to know precisely what each of these changes does and whether they open up new vulnerabilities and then having confidence that all is well. Gaining this confidence requires work. And unless you put that work in, you are left to trusting/believing.

(Edit: what I mean here is that the researchers could be totally nice and ethical people, but the Linux devs would still have to either take a risk by trusting them OR put in the work to check it all OR decide not to put in that work)

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by addingnumbers on Friday May 21, 2021 @10:28AM (#27234398)
80 developers reviewing for a month isn't enough work for you? They just put more man-hours into reviewing these commits than the contributors put into writing them.
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by fartcannon on Friday May 21, 2021 @10:39AM (#27234551)
It'll be interesting to see their next paper, where they describe in great depth how to waste 80 developers time for a month and still sneak in vulnerabilities.
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by high_density on Saturday May 22, 2021 @12:48AM (#27243591)
if 80 devs all read the same part same way, it won't make much of a difference.

maybe the issue is we aren't using static analysis enough / don't have enough static analysis tools?

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by neatze on Friday May 21, 2021 @10:40AM (#27234568)
> researchers could be totally nice and ethical people.

A thorough review of the IRB documents revealed potential problems in the description of the experiments, and concluded that insufficient details about the experimental study were provided to the IRB. [0]

[0]Read the above linked IEEE response latter.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by finnthehuman on Friday May 21, 2021 @10:13AM (#27234178)
I just read that IEEE statement, I'm glad someone else has started noticing the paper was bullshit in addition to unethical:

> Investigation of these patches revealed that the description provided by the authors in the paper is ambiguous and in some cases misleading. The experiments do not provide convincing evidence to substantiate the main claims in the paper and the technical contributions of the work need to be revisited.

Interesting that they list ethical considerations added to the review process, but are not adding content quality considerations to the review process. I think that's at least as embarrassing to PC. You can say that they erred in assuming the uni covered the ethics review, but what are they doing if they're accepting papers without checking that the papers support their own claims?

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by rcxdude on Friday May 21, 2021 @11:25AM (#27235250)
Yeah, the most hilarious part of the TAB report is that one of the hypocrite commits which was supposed to be incorrect was in fact accidentally correct because the authors failed to understand how the code worked. This was also the only commit which got accepted. This makes the conclusions and way data was presented in the paper extremely questionable.
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by consp on Friday May 21, 2021 @12:38PM (#27236331)
> This makes the conclusions and way data was presented in the paper extremely questionable.

This makes them invalid. Their entire claim is based on malicious code entering the kernel, not anonymous/fake name commits (which is a separate issue). If you take that away there is no actual paper, just a hypothesis which everyone already knew and thus does not warrant this much fanfare. They added nothing to the research field, bothered people with it while contributing to no-one but themselves.

This is what we around here now call "Diederik Stapelen" (since he is a infamous example here): faking you data, using people to do/in your work, presenting it as true and gaining from it. It is omnipresent in some fields and in my opinion should be met with severe repercussions as it damages everyone else who was not part of it.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by Ar-Curunir on Friday May 21, 2021 @01:53PM (#27237489)
Err the PC is already supposed to vet for quality. That they failed to do so adequately is not because the policies omitted that requirement, but probably more because Oakland receives many many submissions
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by kuu on Friday May 21, 2021 @09:58AM (#27234050)
This is awful:

> Based on the overall positive reviews and the recommendation of all reviewers to accept the work, the PC did not discuss this paper during the online PC meeting; [...] When, after acceptance, the authors tweeted the abstract of the work in November 2020, several people expressed concerns about human-subject research featured in this work. At that time, the PC chairs discussed these concerns [...]. As a result of these discussions, the PC chairs asked the authors to clarify the experiments with the University of Minnesota Institutional Review Board (IRB). We now acknowledge that this offer was a mistake

Basically: they did not review it and once it was published and people complained, they reacted. What's the point of the PC then?

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by neatze on Friday May 21, 2021 @10:53AM (#27234788)
What really happened (to the best of my understanding):

- Researchers submitted paper to IEEE.

- Researcher twitter about it.

- Tweet was deleted, because people pointed out it was bad humans subject researcher. (consent and deception)

- Other researchers not from UNM, filled complaints to IEEE.

- Researcher mislead (so far seems like) IRB, arguably IRB failed to do a job and just rubber stamped human subject research exemption, after research was conducted ...

- Paper got accepted to IEEE.

- Researchers push more patches to Linux kernel.

- Plonk email from Greg.

- UNM response latter indirectly blaming only researchers but not IRB.

- Paper get retracted from IEEE

- IEEE Response letter.

- We are here.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by gnud on Friday May 21, 2021 @09:56AM (#27234022)
Well, apparently they needed the bad publicity and "overreaction" to actually do that.

The fact that they didn't communicate _clearly_ with the kernel about exactly which patches this was about at the time when they announced their paper is extremely icky, and makes my sympathy for later misunderstandings/misinformation very limited.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by Foxboron on Friday May 21, 2021 @10:01AM (#27234076)
The entire incident has been disappointing.

The researchers conducting the research thinking this was a good idea, the IRB review process at the UMN, IEEE accepting the IRB exception after ethical concerns where raised, and the overreaction from gregkh on the LKML.

Hopefully there is a silver lining and we see better research collaboration between the kernel devs and researchers going forward. IEEE has a job to do around all of this going forward.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by inetknght on Friday May 21, 2021 @10:10AM (#27234159)
> the overreaction from gregkh on the LKML

I don't think it was an overreaction. I think it was a very valid reaction.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by nitrogen on Friday May 21, 2021 @12:31PM (#27236231)
The sort of reaction an emperor has upon finding their shiny new clothes don't actually exist. It's bad the tailors sold fake clothes, but it's also bad the emperor and co. didn't notice sooner.

Here we saw the emperor go on a full war path against the entire place of origin of a couple of misguided individuals. Not a proportionate response.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by simlevesque on Friday May 21, 2021 @12:44PM (#27236418)
Institutional Review Board dropped the ball and failed at their job. Which reflects on the institution. It's not just about individuals.
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by saalweachter on Friday May 21, 2021 @02:47PM (#27238212)
Eh, maybe, but at the same time, I kind of got the feeling that the researchers were treating the IRB as one more layer of security to get around.

The IRB is a gatekeeper, yes, but it is also a resource. You should be working with the IRB to make sure everything you are doing is above the board, because ultimately, if you do something unethical or harmful to individuals or society, that's still on you, even if you got your plan stamped by the IRB. You shouldn't have an antagonistic relationship where you use the vague and technically accurate but misleading descriptions of your research an an attempt to get a "get out of consequences free" card.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by webmaven on Friday May 21, 2021 @11:47PM (#27243230)
> Eh, maybe, but at the same time, I kind of got the feeling that the researchers were treating the IRB as one more layer of security to get around.

Which suggests an entirely new line of inquiry: testing IRB procedures to see whether unethical proposals will be approved if described in misleading terms.

While we're at it, we should check to see whether proposals ostensibly from people who are not faculty or students, or who perhaps don't even exist, are ever approved.

Regardless of the results, we can conclude that having to sign a statement promising to never do unethical research before submitting a proposal, and insisting on identity verification before proposals are reviewed, will lower the chances of unethical research proposals slipping through.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by michaelmrose on Friday May 21, 2021 @01:33PM (#27237149)
The emperor doesn't lack for clothing its just only bulletproof up to a point and a lot of security is actually down to trust and so when an apparently trusted individual walked up and put a rifle to the emperors chest the bullet got through. Nothing of value was learned. Everyone on earth knew a bad patch pushed by a trusted party could potentially get through.
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by Foxboron on Friday May 21, 2021 @10:19AM (#27234269)
There are a few issues with blaming someone for sending known malicious patches which just causes confusion and is outright wrong. Brad Spengler is a... character, but I do agree with him that greg started out on this wrong. (He also goes a bit further with his criticism that I don't agree with).

However yes, review of the patches was proper but all this could have been done with less unfounded accusations from gregs side.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by fartcannon on Friday May 21, 2021 @10:44AM (#27234637)
From the outside, Greg appears to behave like a saint through this enitre process. The university, professors and students involved in this calamity have demonatrated precisely why software developers really need to be bound by ethics.
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by neatze on Friday May 21, 2021 @10:42AM (#27234607)
Can you provide specifics what do you mean exactly by unfounded accusations ?

Really curious who makes unfunded accusations ...

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by Foxboron on Friday May 21, 2021 @10:45AM (#27234648)
https://lore.kernel.org/linux-nfs/YH5%[email protected]...

And the resulting conversations between Aditya Pakki and Greg. Aditya was never part of the hypocrite commit research, accusing them for this is just bad.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by HarryHirsch on Friday May 21, 2021 @12:12PM (#27235939)
The "hypocrite commit" project was using the kernel developers to further Kangjie Lu's career goals. Aditya was using the kernel developers' time to further his research project, his static analyzer. There's no material difference.
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by shadowgovt on Friday May 21, 2021 @11:07AM (#27234996)
That's the problem with bad-faith action by an institution... It casts a shadow on the actions of all the other agents of the institution.

Greg's concerns proved to be overblown, but at the time they were raised he had reason to believe them valid.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by gnud on Friday May 21, 2021 @07:34PM (#27241287)
That's easy to say now.

At the time, UMC had not "debriefed" the kernel maintainers they lied to in the "hypocrite commits".

And then Pakki didn't mention that these new patches were generated by a tool, and submitted a bunch of "nonsense" patches with no explanation.

What reason did GKH have to trust anyone associated with the "hypocrite commits" at that point?

(ps. don't think you deserve all the downvotes here...)

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by Foxboron on Friday May 21, 2021 @08:05PM (#27241604)
I said the same thing then. The pre-print was public at that point and I had been following it since December, sharing thesis adviser doesn't make you associated with research conducted months prior.

Yes, they are bad patches and the research is also questionable. But this is not bad faith nor malicious.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by fartcannon on Friday May 21, 2021 @10:54AM (#27234813)
Are you Aditya? You write quite a bit like them.

Do you want to take a moment and explain how your broken static anylizer isn't involved?

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by Foxboron on Friday May 21, 2021 @10:57AM (#27234848)
Please google me. You'll quickly learn I'm a 26 year old Norwegian FOSS maintainer named "Morten Linderud".

Or, y'know. Click on the profile.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by fartcannon on Friday May 21, 2021 @10:59AM (#27234871)
Passionate! I like it, Morten. It's rare.

I did click your profile, but this is a post about deception. Trust no one.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by bronson on Friday May 21, 2021 @12:25PM (#27236130)
They lied in their abstract: https://twitter.com/SarahJamieLewis/status/13848760502079406...

They lied to their IRB.

What evidence do you have that they're telling the truth now?

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by cptskippy on Friday May 21, 2021 @10:26AM (#27234373)
> We do know since the researchers have told the linux community

Replace researchers with hackers, CIA, North Korea, China, etc. Do you still have the warm fuzzies?

The fact of the matter is they broke the trust and your expectation is that since they've been exposed they can be trusted again?

No, if anything the event has shown that additional vetting and layers of scrutiny might be needed to protect against bad actors in the future should they be malicious.

* I type good.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by oauea on Friday May 21, 2021 @10:56AM (#27234835)
Sorry, why would you believe the words of bad actors who are known to lie? Can you be absolutely certain this isn't simply a continuation of their twisted "experiment"?
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by na85 on Friday May 21, 2021 @01:32PM (#27237135)
>We do know since the researchers have told the linux community, the university and IEEE what those patches where. Please do not spread further misinformation about the case.

We should just trust the liars when they pinky swear to tell the truth? There's a certain saying about what you win when you play shitty games that comes to mind. Being deceptive causes people to lose trust in you.

Or, my personal favorite: fuck around, find out. UMN fucked around, now they're finding out.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by blumomo on Friday May 21, 2021 @09:54AM (#27234002)
"Please do not spread further misinformation about the case."

Let's assume that most people are giving their opinions to their best knowledge. We shall be careful when telling someone to stop spreading misinformation as this is how fascism starts. "I am right, you are wrong, stop talking!"

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by rcxdude on Friday May 21, 2021 @11:21AM (#27235202)
Even when people are giving their opinions to their best knowledge they can be spreading misinformation.
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by Glavnokoman on Saturday May 22, 2021 @11:55AM (#27247702)
Calling everything that's at odds with ones beliefs misinformation is stupid in the first place. And I believe the word is used precisely in this sense most of the time. Definitely here.
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by blumomo on Friday May 21, 2021 @11:58AM (#27235746)
Is it forbidden to do mistakes? In such cases is it a good idea to respond to your colleagues with "Please stop doing mistakes!" as the parent did?
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by rcxdude on Friday May 21, 2021 @12:46PM (#27236453)
No, but it may be reasonable to ask 'please do not repeat this particular mistake'
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by shkkmo on Friday May 21, 2021 @02:56PM (#27238349)
But in the particular case, the discussion centers around a matter of opinion on "should trust be extended to this particular set of statements from a known deciever".

Throwing around accusations of spreading misinformation to further your opinion in an argument makes it harder to call out real misinformation.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by blumomo on Friday May 21, 2021 @03:14PM (#27238604)
Did you ever say such thing to someone who committed an error? How would you feel if someone (your partner, your colleague, your boss) told you such thing?
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by Glavnokoman on Saturday May 22, 2021 @03:13AM (#27244283)
I can only suggest that you stop spreading your misbeliefs about the case. And also stop using the buzzwords the meaning of which you apparently do not understand.
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by 4ad on Friday May 21, 2021 @09:52AM (#27233988)
Ah, so we're just supposed to trust the same people who tried introducing the vulnerabilities in the first place...
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by Foxboron on Friday May 21, 2021 @09:55AM (#27234014)
These are not independent malicious actors. These are researchers and students at a University. FUD does not serve any purpose here.

And for full disclosure, I'm one of the four authors of the original complaint to IEEE back in December about the research. I fully believe all the facts have been put forth and there is no reason to spread misinformation about the incident.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by finnthehuman on Friday May 21, 2021 @10:30AM (#27234431)
>These are not independent malicious actors. These are researchers and students at a University.

They wanted to prove that others are too trusting, they got exactly what they wanted: heightened suspicion to things that are normally expected to be done in good faith.

I understand that inside the academic world the status imparted by "researchers and students at a University" is significant and important. For those of us outside the academic world, it's prudent and has no downside for us to drop our perception of them below the floor you'll continue granting them.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by hinkley on Friday May 21, 2021 @12:18PM (#27236024)
This situation is in combination with the longstanding disconnect between academic researchers and applied sciences folks. I say “disconnect” as if that were a two way street, but most of the spherical cow thinkers are on the academic side. People doing real work bristle at their lack of exposure to reality. I worked while still in school and the difference was literally and figuratively night and day. I quickly became an informed consumer and it meant that sometimes in class I was sitting on my hands to keep from disagreeing with the teachers about why something is done a certain way. It was shocking how often they were wrong, and occasionally ass backward. Ultimately I couldn’t get out of there fast enough.

But season this old recipe heavily with some “fuck around and find out” and things get pretty spicy.

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by coldpie on Friday May 21, 2021 @01:47PM (#27237381)
The fact that this paper was in the best 5% of papers submitted to this IEEE conference[1] tells you all you need to know about academia.

[1] https://www.ieee-security.org/TC/SP2021/downloads/2021_PC_St...

Re:Linux 5.13 Reverts and Fixes the Problematic University o... by mukesh610 on Friday May 21, 2021 @10:05AM (#27234106)
That's exactly the opposite of what the initial comment of this thread suggests.
Re:Linux 5.13 Reverts and Fixes the Problematic University o... by aspaceman on Friday May 21, 2021 @09:58AM (#27234048)
Christ the snark is infuriating.

And pointless?