Re:PoisonGPT: We hid a lobotomized LLM on Hugging Face to sp...
by boredumb on Sunday July 09, 2023 @01:22PM
(#36656455)
People can be snarky about using 'untrusted code' but in 2023 this is the default for a lot of places and a majority of individual developers when the rubber meets the road. Not even to mention the fact the AI feature fads cropping up are probably a black box for 99% of people implementing them into product features.
[ Parent
| on HN ]
Re:PoisonGPT: We hid a lobotomized LLM on Hugging Face to sp...
by krainboltgreene on Sunday July 09, 2023 @02:11PM
(#36657172)
> in 2023 this is the default for a lot of places
This is incredibly hyperbolic.
Re:PoisonGPT: We hid a lobotomized LLM on Hugging Face to sp...
by 3-cheese-sundae on Sunday July 09, 2023 @07:35PM
(#36660206)
Are you sure? It's been accepted as common practice in my 15 year career so far, across multiple industries including automotive, finance, and marketing.
Re:PoisonGPT: We hid a lobotomized LLM on Hugging Face to sp...
by alexpotato on Sunday July 09, 2023 @09:51PM
(#36661088)
I agree with this.
I have never seen a firm say "hey, we should dig down the dependency chain to ensure that EVERY SINGLE package we use is fully signed and from a trusted (for some degree of trusted) source"
If anything it's more like "we are bumping Pandas versions and Pandas is famous for changing the output of functions from version to version and we have no specific tests to catch that. What should we do??"
Re:PoisonGPT: We hid a lobotomized LLM on Hugging Face to sp...
by nicce on Sunday July 09, 2023 @10:05PM
(#36661183)
Not to mention that we still use and trust many closed-source applications.
I am even writing this on one (Safari).
Re:PoisonGPT: We hid a lobotomized LLM on Hugging Face to sp...
by lmm on Sunday July 09, 2023 @10:02PM
(#36661162)
When I worked in finance every dependency was checked and we had to know who the responsible vendor was, or have an internal owner in the case where we were using something as freeware (and we preferred to have a vendor contract even for open-source). We didn't dig much deeper than "who is it and what's their reputation", but we absolutely had a record of where each dependency was from and a name on the list.
Re:PoisonGPT: We hid a lobotomized LLM on Hugging Face to sp...
by mowse_winded on Monday July 10, 2023 @06:54AM
(#36664560)
But then did you check every one of their dependencies?
Re:PoisonGPT: We hid a lobotomized LLM on Hugging Face to sp...
by lmm on Monday July 10, 2023 @07:40PM
(#36674587)
We treated transitive dependencies the same as any other dependencies (i.e. they had to have an owner and be audited etc.). We didn't audit our suppliers' build toolchains or vendored dependencies, but would've considered them responsible if something malicious came in that way.