News for hackers. Stuff that matters.
Re:Generate and Pray: Using SALLMs to Evaluate the Security ... by jruohonen on Thursday November 02, 2023 @11:20PM (#38124052)
A lot of work on this topic; a consensus seems to be emerging that LLMs indeed output insecure code.

That said, I didn't quite grasp the approach in this piece. Basically, they supply insecure code snippets to a LLM and evaluate its output. However, these snippets are actually data that has been used to train the LLM. So I am not sure about the causal reasoning here, although I might have misunderstood something.

Re:Generate and Pray: Using SALLMs to Evaluate the Security ... by tydunn on Friday November 03, 2023 @11:09AM (#38129948)
> RQ2 Findings: StarCoder generated more secure code than CodeGen-2B, CodeGen-2.5 7B, GPT-3.5 and GPT-4.

I wonder why StarCoder might generate more secure code