News for hackers. Stuff that matters.
Re:38TB of data accidentally exposed by Microsoft AI researc... by quickthrower2 on Monday September 18, 2023 @11:51AM (#37557885)
Two of the things that make me cringe are mentioned. Pickle files and SAS tokens. I get nervous dealing with Azure storage. Use RBAC. They should depreciate SAS and account keys IMO.

SOC2 type auditing should have been done here so I am surprised of the reach. Having the SAS with no expiry and then the deep level of access it gave including machine backups with their own tokens. A lot of lack of defence in depth going on there.

My view is burn all secrets. Burn all environment variables. I think most systems can work based on roles. Important humans access via username password and other factors.

If you are working in one cloud you don’t in theory need secrets. If not I had the idea the other day that proxies tightly couples to vaults could be used as api adaptors to convert then into RBAC too. But I am not a security expert just paranoid lol.

Re:38TB of data accidentally exposed by Microsoft AI researc... by hypeatei on Monday September 18, 2023 @12:29PM (#37558413)
Absolutely, RBAC should be the default. I would also advocate separate storage accounts for public-facing data, so that any misconfiguration doesn't affect your sensitive data. Just typical "security in layers" thinking that apparently this department in MSFT didn't have.
Re:38TB of data accidentally exposed by Microsoft AI researc... by bunderbunder on Monday September 18, 2023 @12:02PM (#37558043)
Pickle files are cringe, but they're also basically unavoidable when working with Python machine learning infrastructure. None of the major ML packages provide a proper model serialization/deserialization mechanism.

In the case of scikit-learn, the code implementing some components does so much crazy dynamic shit that it might not even be feasible to provide a well-engineered serde mechanism without a major rewrite. Or at least, that's roughly what the project's maintainers say whenever they close tickets requesting such a thing.

Re:38TB of data accidentally exposed by Microsoft AI researc... by osanseviero on Monday September 18, 2023 @12:17PM (#37558255)
You should check out safetensors. They are used widely in diffusion models and LLMs https://huggingface.co/blog/safetensors-security-audit
Re:38TB of data accidentally exposed by Microsoft AI researc... by jklehm on Monday September 18, 2023 @12:12PM (#37558201)
ONNX[0], model-as-protosbufs, continuing to gain adoption will hopefully solve this issue.

[0] https://github.com/onnx/onnx

Re:38TB of data accidentally exposed by Microsoft AI researc... by bunderbunder on Monday September 18, 2023 @12:23PM (#37558336)
ONNX is cool, but it still only supports a minority of scikit-learn components. Some of them simply aren't compatible with ONNX's basic design.
Re:38TB of data accidentally exposed by Microsoft AI researc... by mxz3000 on Monday September 18, 2023 @12:15PM (#37558233)
at work we use the ONNX serialisation format for all of our prod models. Those get loaded by the ONNX runtime for inference. works great.

perhaps it's be viable to add support for the ONNX format even for use cases like model checkpointing during training, etc ?

Re:38TB of data accidentally exposed by Microsoft AI researc... by prmoustache on Monday September 18, 2023 @12:45PM (#37558590)
Many SOC2 audits are a joke. We were audited this year and were asked to provide screenshots of various categories (but most being of our own choosing in the end). Only requirement was screenshots needed to show date of the computer on which the screenshot had been taken, as if it couldn't be forged as well as the file/exif data.
Re:38TB of data accidentally exposed by Microsoft AI researc... by lijok on Monday September 18, 2023 @03:16PM (#37560664)
If you forge your SOC2 evidence you will legitimately wish you were never born once caught
Re:38TB of data accidentally exposed by Microsoft AI researc... by prmoustache on Monday September 18, 2023 @04:30PM (#37561573)
We aren't doing that. I just mention the lazyness of the auditors and that asking for screenshots is just dumb. At this point you can just ask a simply question: do you comply or not?
Re:38TB of data accidentally exposed by Microsoft AI researc... by ozim on Monday September 18, 2023 @01:01PM (#37558812)
So SAS tokens are worse that some admin setting up "FileDownloaderAccount" and then sharing its password with multiple users or using the same for different applications?

I take SAS tokens with expiration over people setting up shared RBAC account and sharing password for it.

Yes people should do proper RBAC, but point a company and I will find dozens "shared" accounts. People don't care and don't mind. When beating them up with sticks does not solve the issue SAS tokens while still not perfect help quite a lot.

Re:38TB of data accidentally exposed by Microsoft AI researc... by quickthrower2 on Monday September 18, 2023 @06:08PM (#37562766)
FileDownloaderAccount had no copy pastable secret that can be leaked. Shared passwords are unnecessary of course and not good. If people are going to do that just use OneDrive/Dropbox rather than letting people use advanced things.