Re:ChatGPT Is Now Finding Bugs in Databases
by colechristensen on Thursday March 09, 2023 @09:30PM
(#35089719)
These models have probably been trained on a large portion of the Internet.
The training data however can be a few years old.
I have noticed this when trying to get it to generate some code, it was clearly using considerably old versions.
Re:ChatGPT Is Now Finding Bugs in Databases
by codebje on Thursday March 09, 2023 @11:18PM
(#35090323)
> I have noticed this when trying to get it to generate some code, it was clearly using considerably old versions.
I have noticed the same thing when trying to use junior devs to generate some code, usually correlating with how old the most popular Stack Overflow question on the subject is.
Re:ChatGPT Is Now Finding Bugs in Databases
by colechristensen on Friday March 10, 2023 @01:30AM
(#35091118)
This is how we decided to describe chatgpt’s programming ability the other day. A very fast but somewhat inadequate jr developer. Is amazing really but you also have to ask for the same thing a dozen times and still spend quite a while figuring out what’s wrong with it.
Re:ChatGPT Is Now Finding Bugs in Databases
by Godel_unicode on Friday March 10, 2023 @01:54AM
(#35091266)
What I have been doing is asking it for code and then asking it to find bugs in that code. The bug finding works relatively well.
At the time it _seemed_ like it wasn't just doing a mindless string replace, because different parts of the url changed on most of the erroneous links. I figured it wasn't going out and spidering the link I gave, but it led me to believe maybe there was _some_ form of index that it simply hadn't prioritized prior, but was able to do with the additional context.