News for hackers. Stuff that matters.

A comment on Claude AI built me a React app to compare maps side by side. Parent comment

Re:Claude AI built me a React app to compare maps side by side by danieldk on Sunday November 17, 2024 @10:45AM (#42164759)
The best vulnerability is one that is hard to detect because it looks like a bug. It's not inconceivable to train an LLM to silently slip vulnerabilities in generated code. Someone who does not have a whole lot of programming experience is unlikely to detect it.

tl;dr it takes running untrusted code to a new level.

[ Parent | on HN ]
Re:Claude AI built me a React app to compare maps side by side by caspg on Sunday November 17, 2024 @10:51AM (#42164794)
WebAssembly sandboxes might become handy.
[ Parent | on HN ]
Re:Claude AI built me a React app to compare maps side by side by troupo on Sunday November 17, 2024 @11:22AM (#42164992)
That guards against a small subset of vulnerabilities.

Since the original desire was to build any kind of personal/commercial app on an OS, the amount of potential vulnerabilities is potentially infinite.

[ Parent | on HN ]
Re:Claude AI built me a React app to compare maps side by side by sdesol on Sunday November 17, 2024 @11:35AM (#42165064)
This ultimately why I believe Microsoft and Apple will be the big winners. I suspect a lot of companies will want Microsoft and Apple to sign off on things and Microsoft and Apple are going to make sure they get their cut. We may need a new layer above existing operating systems in the future, to safeguard things.
[ Parent | on HN ]
Re:Claude AI built me a React app to compare maps side by side by jstummbillig on Sunday November 17, 2024 @01:22PM (#42165835)
Meh. Why would the model makers not be fantastic security vectors? The motivation to not be the company known to "silently slip vulnerabilities in generated code" seems fairly obvious.

People have always been able to slip in errors. I am confused why we assume that a LLM will on average not be better but worse on this front, and I suspect a lot of residual human-bias and copium.

[ Parent | on HN ]