byt3bl33d3r
AI doesn't make you more efficient
It will be extremely interesting to see how vulnerability discovery evolves with LLMs but the whole "sky is falling hide your kids" hype cycle is ludicrous.
The argument that LLMs will enable "super powered" malware and that existing security solutions won't be able to keep up, is completely overblown. I see 0 evidence of this being possible with the current incarnation of "AI" or LLMs.
"Vide coded" malware will be easier to detect if the people creating it don't understand what the code is actually doing and will result in incredible amount of OpSec fails when the malware actually hits the target systems.
I do agree that "vide coding" will accelerate malware development and generally increase the amount of attacks to orgs. However if you're already applying bog-standard security practices like defense in depth, you shouldn't be concerned about this. If anything, you might want to start thinking about SOC automations in order to reduce alert fatigue.
Stay far away from anyone trying to sell you products to defend against "AI enabled malware". As of right now it's 100% snake oil.
Also, this is probably one of the cringiest articles on the subject I've ever read and is only meant to spread FUD.
I do find the banner video extremely entertaining however.
RCE in Nvidia Triton Inference Server
[1] https://github.com/protectai/ai-exploits?tab=readme-ov-file#...
[1] https://owasp.org/www-project-machine-learning-security-top-... [2] https://atlas.mitre.org/
This is a problem that's existed since the creation of the AV/EDR industry and is not going away as vendors have 0 motivation to address it. All programming languages have had to deal with this issue, this is definitely not targeted towards the Nim language.
- If you're a Nim developer trying to deploy a production app in a Windows environment: get a code signing cert and slap it on your application (signing the compiler won't help).
- If you're trying to develop a Nim app in an organization that has an EDR/AV deployed: you're going to have to talk with your friendly neighborhood security folks and work with them to whitelist the Nim compiler, tooling and folders where you work with Nim code.
You'll still be subjected to the EDR/AVs WinAPI hooking and behavioral heuristics even with the code signing cert and sometimes even after whitelisting depending on the product so you still might get issues were the AV/EDR is affecting your application but at least it won't straight up quarantine it and go ape shit.
EDIT: just to be clear: EDR the root cause of this is the AV/EDR industry not doing due diligence. Unfortunately, I'm very skeptical of them doing anything about this as their entire business model revolves around "cast a wide net in the attempt to catch as many things as possible".