News for hackers. Stuff that matters.
Re:Python Is Eating the World by acdha on Monday August 12, 2019 @09:20AM (#20675132)
It’s running over HTTPS from an auditable source. Is that _really_ so much worse than a pip install, and can you explain in detail why you believe that to be true?
Re:Python Is Eating the World by linsomniac on Tuesday August 13, 2019 @09:31AM (#20685613)
I teach my kids to use the right tool for the job, because using the wrong tool for the job can lead to injuries. But I violate this all the time, myself. It's just a good habit to get into.

"curl | bash" is a bad habit to get into. It works under certain circumstances, like making sure it's an SSL connection from a source you trust. But it's just a bad habit for the average person to get into.

Re:Python Is Eating the World by chrisfinazzo on Monday August 12, 2019 @10:04AM (#20675500)
Somewhere, I can hear John Siracusa saying, 'curl piped into a shell? No thanks.'
Re:Python Is Eating the World by acdha on Monday August 12, 2019 @10:19AM (#20675614)
Yes, funny, but seriously, where's the threat model where you've analyzed the risks of installing code from GitHub over HTTPS and found it to be less secure?
Re:Python Is Eating the World by chrisfinazzo on Monday August 12, 2019 @10:29AM (#20675708)
To be clear, either of these methods can have problems, it's not unique to curl and your shell of choice. Some of the better open source projects will say up front that if you are concerned about this kind of thing, feel free to read the installer script and decide for yourself if everything's kosher.
Re:Python Is Eating the World by acdha on Monday August 12, 2019 @01:35PM (#20677782)
Yes, my point was that if you're worried about running someone else's code the answer is to audit that code rather than the transport layer. There are valid concerns with HTTP or in scenarios where something could be targeted to a single user, but neither of those are relevant to 99% of the time people raise this complaint.
Re:Python Is Eating the World by dTal on Tuesday August 13, 2019 @05:38AM (#20684040)
There's always the risk that the script will fail to completely download and leave your system in a broken state. This can be mitigated against by the script authors by wrapping everything in a function which is called on the last line, but how do you know they've done that without downloading the script and checking first?

(Poetry have done this, for what it's worth)

Re:Python Is Eating the World by MiroF on Monday August 12, 2019 @01:43PM (#20677877)
it's pretty easy to detect only when you are being piped and then only include malicious code then
Re:Python Is Eating the World by acdha on Monday August 12, 2019 @08:59PM (#20681798)
Do you believe GitHub has that infrastructure deployed? If not, this is a blind alley to worry about. If so, what other precautions have you taken to avoid compromised tarballs, unauthorized pushes to repos with auto-deployment pipelines, etc.?

The point is that in reality you’re orders of magnitude more likely to be compromised by ads in your browser, an undetected flaw in legitimate code, or a compromised maintainer than GitHub having deployed custom infrastructure to target you. If you’re being target by a government, why would they do this instead of using the same TLS exploit to serve you a dodgy Chrome or OS update which is harder to detect and will work against 100% of targets?

Re:Python Is Eating the World by tekknik on Tuesday August 13, 2019 @12:30AM (#20682850)
So because ads can compromise us we should ignore the security of package managers?

How about this for a reason, where are the checksums when I’m curling and piping? How do I validate in an automated fashion the validity of this file I’m piping into an interpreter? When installing a package it’s quite easy to have redundant copies of an index with checksums pointing to a repository hosting the actual code. The attack surface is much smaller vs a curl | python

This is bad practice, stop promoting it or downplaying it’s security issues.

Edit: smaller instead of larger

Re:Python Is Eating the World by acdha on Tuesday August 13, 2019 @07:13AM (#20684587)
HTTPS has checksums, and note that we’re specifically talking about installing from Github, where every change is tracked.

> This is bad practice, stop promoting it or downplaying it’s security issues.

I’m trying to get you to do some security analysis focused on threats which are possible in this model but not the real alternatives (download and install, install from a registry like PyPI or NPM, etc.). So far we have “GitHub could choose to destroy their business”, which seems like an acceptable risk and about the same as “NPM could destroy their business”.

Re:Python Is Eating the World by tekknik on Tuesday August 13, 2019 @10:42AM (#20686293)
HTTPS doesn’t know if the file changed on the server so that doesn’t count here.

I am doing security analysis. If this file changes and I’m using it in built server images then I have no way of automatically validating the changes are good without doing the checksumming myself and managing this data. What we have is a server that can be hacked and the files are unable to be verified by checksum

Re:Python Is Eating the World by MiroF on Tuesday August 13, 2019 @10:32AM (#20686186)
Fair point - I didn't actually click so I didn't see that it was a Github link, I was just reading the comments.