News for hackers. Stuff that matters.
Re:A Study of Malicious Code in PyPI Ecosystem by 7373737373 on Friday September 08, 2023 @11:18AM (#37434679)
It's (partially) a fundamental problem with Python and (all?) other popular programming languages. The majority of libraries don't need more authority than doing (some) computation, yet any Python script can access anything and everything by default.

The https://en.wikipedia.org/wiki/Principle_of_least_privilege as constructed by https://en.wikipedia.org/wiki/Capability-based_security is the solution for this, yet Python will probably never be capable of this kind of internal encapsulation, it's too much of a fundamental change - and even if some sort of sandboxing ability is accomplished, creating separate/recursive sandboxes (needed when importing more, separate libraries) will probably require another interpreter instance (as with WebAssembly).

I hope current and future language designers will take this into account, and construct their compilers, virtual machines and interpreters accordingly. Python was created before the internet as we know it now existed, so perhaps its lack of security mechanisms shouldn't be surprising. But it and any new developments that fail to consider this aspect of computation will be fundamentally flawed from the beginning.

https://github.com/void4/notes/issues/41

Re:A Study of Malicious Code in PyPI Ecosystem by simonw on Friday September 08, 2023 @12:01PM (#37435382)
This is why I'm so interested in running Python (and almost every other language) inside a WebAssembly sandbox.

It's 2023. I never want to run untrusted code on any of my devices outside of a sandbox ever again.

WebAssembly feels like it should be that sandbox. Every few months I check to see if it's easy enough to run regular Python/JavaScript/etc code inside a WebAssembly sandbox yet... we're not quite there but it feels really close.

More notes here: https://til.simonwillison.net/webassembly/python-in-a-wasm-s...

Re:A Study of Malicious Code in PyPI Ecosystem by mhh__ on Friday September 08, 2023 @12:27PM (#37435766)
WebAssembly as a platform is probably as good as any other, but I think as an ISA and compilation target they flubbed a lot of the basics. It's slightly too clever, slightly too awkward to target seamlessly etc
Re:A Study of Malicious Code in PyPI Ecosystem by ashishbijlani on Friday September 08, 2023 @12:33PM (#37435847)
Curious to know why existing sandboxing/isolation technologies like VMs & Containers not enough here?
Re:A Study of Malicious Code in PyPI Ecosystem by simonw on Friday September 08, 2023 @12:38PM (#37435924)
They're not lightweight and easy enough to use.

I have Docker on my Mac. I run things in it if I have to, but it's pretty resource heavy and I have to look at my notes every time I want to run "docker run".

Plus Docker isn't actually a fully secure sandbox!

There's Firecracker, which I believe is secure (AWS built it for Lambda after all) but good luck figuring out how to run that on a Mac.

I want something that's tiny, fast, ridiculously easy to use and that I can run dozens if not hundreds of instances.

WebAssembly is almost that thing.

Re:A Study of Malicious Code in PyPI Ecosystem by ashishbijlani on Friday September 08, 2023 @01:09PM (#37436346)
> There's Firecracker, which I believe is secure (AWS built it for Lambda after all) but good luck figuring out how to run that on a Mac.

Then, how about using AWS Lambda for your use case?

Re:A Study of Malicious Code in PyPI Ecosystem by simonw on Friday September 08, 2023 @02:45PM (#37437686)
I want to run code on my own laptop and phone.
Re:A Study of Malicious Code in PyPI Ecosystem by ashishbijlani on Friday September 08, 2023 @03:39PM (#37438401)
Makes sense. When I read your notes, it appeared that you wanted to run untrusted code on a backend server.
Re:A Study of Malicious Code in PyPI Ecosystem by simonw on Friday September 08, 2023 @03:50PM (#37438548)
Yeah, I want to do that as well! And Lambda is definitely high on my list of potential solutions for that.

I'm still hoping for a solution to the run-on-personal-devices problem though.

Re:A Study of Malicious Code in PyPI Ecosystem by g_p on Friday September 08, 2023 @01:59PM (#37437071)
Interestingly, Docker on Mac actually runs lightweight VM, which then runs a whole Linux OS inside it, to then run your containers.

From an isolation perspective, that's giving you hypervisor level isolation which is a step above most container-based solutions, which you point out rightly isn't a full sandbox. A hypervisor with CPU support is probably the gold standard for isolation, asides from running it on a separate physically isolated system.

Re:A Study of Malicious Code in PyPI Ecosystem by rrherr on Friday September 08, 2023 @06:59PM (#37440334)
Agreed about Docker.

Personally, I use Google Colab for my convenient, lightweight Python sandbox. But I’d rather not depend on Google. It feels weird that this is my best option for now.

Re:A Study of Malicious Code in PyPI Ecosystem by Intralexical on Friday September 08, 2023 @09:20PM (#37441249)
> Personally, I use Google Colab for my convenient, lightweight Python sandbox. But I’d rather not depend on Google. It feels weird that this is my best option for now.

`bwrap` is great for this on Linux. A one line alias should let you run any program in a lightweight and highly customizable sandbox safely-ish. See my reply to the parent comment for an example.

Re:A Study of Malicious Code in PyPI Ecosystem by Intralexical on Friday September 08, 2023 @09:14PM (#37441225)
> They're not lightweight and easy enough to use.

```

$ alias SafeRun="bwrap --ro-bind / / --dev /dev --proc /proc --unshare-all --tmpfs ~ --bind ~/Untrusted ~/Untrusted"

$ SafeRun python3 ~/Untrusted/RandomScript.py

$ SafeRun ~/Untrusted/RandomExecutable

```

This is basically manually invoking what Flatpak does:

https://github.com/containers/bubblewrap

This is also useful for more than just security. E.G., you can test how your app would behave on a fresh install by masking your user configuration files. I personally also have a tool that uses it to basically bundle all dependencies from an entire Linux distribution in order to make highly portable AppImages— Been meaning to post that, will get around to it eventually maybe.

The flags above should hide your user data (`--tmpfs`), disable network access (`--unshare-all`), hide/virtualize devices and OS state (`--dev` and `--proc`), and make the rest of the root filesystem read-only (`--ro-bind`­— Including the insecure X11 socket in `/tmp`, which you might want to expose for GUI apps).

Check them against `bwrap --help`; I might have omitted one or two more things you'd need.

Re:A Study of Malicious Code in PyPI Ecosystem by internet101010 on Friday September 08, 2023 @03:20PM (#37438158)
It's really just a matter of practicality. Developing within docker or a VM is kind of a pain.
Re:A Study of Malicious Code in PyPI Ecosystem by ashishbijlani on Friday September 08, 2023 @03:35PM (#37438353)
Would love to know the specifics I'm missing. Based on my experience, Docker/FC just works out of the box and gives you a shell.
Re:A Study of Malicious Code in PyPI Ecosystem by dagw on Friday September 08, 2023 @03:46PM (#37438490)
A big one that has bitten my team a lot is syncing files between local and container. There are even whole separate tools like https://docker-sync.readthedocs.io designed to try to mitigate the problem. The most annoying thing is it almost works almost all the time and then all of a sudden stop working for some people for no obvious reason. We gave up on Docker for development because we couldn't trust it to work consistently.
Re:A Study of Malicious Code in PyPI Ecosystem by taway1237 on Friday September 08, 2023 @09:26PM (#37441274)
I must be missing something, but why not just mount your code into the container? That's what I usually do.
Re:A Study of Malicious Code in PyPI Ecosystem by dagw on Saturday September 09, 2023 @12:46PM (#37447353)
I have a directory with my files in it and mount that directory into the container. However when I make changes to the files outside the container, those changes aren't always reflected inside the container, causing all kinds of weird behaviour and mismatches. It almost always works as expected, for almost everybody on the team, but everybody with a Mac has experienced this at least once.
Re:A Study of Malicious Code in PyPI Ecosystem by formerly_proven on Friday September 08, 2023 @12:14PM (#37435580)
Java and C# used to have this, but both removed it later on.
Re:A Study of Malicious Code in PyPI Ecosystem by 7373737373 on Friday September 08, 2023 @01:20PM (#37436506)
I'd love to read more about why these attempts were abandoned, and how they got the idea to try
Re:A Study of Malicious Code in PyPI Ecosystem by formerly_proven on Friday September 08, 2023 @01:34PM (#37436717)
The JEP to remove it chronicles the rise and fall of java.security: https://openjdk.org/jeps/411