Re:Six tips for better coding with ChatGPT
by throwaway4aday on Tuesday June 06, 2023 @10:56AM
(#36213801)
LLMs are also capable of analyzing, describing, and debugging software. There have been several papers published on this. So I wouldn't worry too much about any new buggy software being produced. In a few years, LLMs will probably be issuing PRs on your repos to fix things you haven't gotten around to or noticed yet.
This actually seems like a great use case. Read and flag potential bugs for review. Although if it wrote the code in the first place how would it identify the bug? What it produced was something close to the most likely result given what it has seen so far
Re:Six tips for better coding with ChatGPT
by throwaway4aday on Wednesday June 07, 2023 @09:44AM
(#36226712)
This paper explains it better than I could in a comment https://arxiv.org/abs/2304.05128
Are you able to back up the claim that ChatGPT code, when refined and deployed to production, is more buggy than code that is patchworked together by 10-20 stack overflow posts until something sticks?
I didn’t make that assertion. My fears are based on the speed that code of unknown quality, which is also poorly understood can be produced. I specifically said:
Granted, us humans are doing that now. Just many orders of magnitude slower. Probably slow enough that we can find/fix the important stuff.
Granted, us humans are doing that now. Just many orders of magnitude slower. Probably slow enough that we can find/fix the important stuff.
The other aspect that terrifies me is the potential for nation state entities with deep pockets to inject vulnerabilities. What would it be worth to the NSA to seed the future with programs they could exploit?