News for hackers. Stuff that matters.
Re:Stack Overflow questions are being flooded with answers f... by brindidrip on Sunday December 04, 2022 @01:28PM (#33856217)
We need to start developing software to detect AI responses.

To detect a response generated by ChatGPT, we could first analyze the content of the response to see if it contains any unnatural or repetitive language. We could also check the formatting of the response to see if it follows the typical conventions used by human responders on the platform. Additionally, we could check for any unusual patterns in the timestamps of the response, as AI-generated responses may be posted more quickly or regularly than responses written by humans. Finally, we could also use machine learning algorithms to train a model to identify responses generated by ChatGPT based on these and other characteristics.

Quick, someone ask ChatGPT to generate the stubs.

Re:Stack Overflow questions are being flooded with answers f... by mojuba on Sunday December 04, 2022 @01:32PM (#33856258)
Your answer sounds like a ChatGPT one. It's actually not hard to tell.
Re:Stack Overflow questions are being flooded with answers f... by Jerrrry on Sunday December 04, 2022 @02:27PM (#33856830)
>Finally, we could also use machine learning algorithms to train a model to identify responses generated by ChatGPT based on these and other characteristics.

whatever your idea (i skimmmed cuz) the discriminator will find it and have the generator apply it to the next generation.

>The core idea of a GAN is based on the "indirect" training through the discriminator, another neural network that can tell how "realistic" the input seems, which itself is also being updated dynamically.[5] This means that the generator is not trained to minimize the distance to a specific image, but rather to fool the discriminator. This enables the model to learn in an unsupervised manner.

https://en.wikipedia.org/wiki/Generative_adversarial_network

Re:Stack Overflow questions are being flooded with answers f... by xdennis on Sunday December 04, 2022 @02:40PM (#33856972)
"We could also... Additionally, we could... Finally, we could" is a dead giveaway.

But to take it seriously, it would be quite sad when actual people will be banned for sounding too much like a bot.

Re:Stack Overflow questions are being flooded with answers f... by calebh on Sunday December 04, 2022 @05:00PM (#33858417)
OpenAI needs to get on top of this and generate a detector for every model they release. And then sell access to both.
Re:Stack Overflow questions are being flooded with answers f... by dragonwriter on Sunday December 04, 2022 @05:02PM (#33858431)
> To detect a response generated by ChatGPT, we could first analyze the content of the response to see if it contains any unnatural or repetitive language. We could also check the formatting of the response to see if it follows the typical conventions used by human responders on the platform.

Given my experience with human responses to text queries, these would be positively correlated.

Re:Stack Overflow questions are being flooded with answers f... by dragonwriter on Sunday December 04, 2022 @05:13PM (#33858521)
> We need to start developing software to detect AI responses.

As soon as we do, it can be tied into AIs as a tool to evade detection, simply by generating multiple responses and returning the one scoring the lowest likelihood of being an AI in the AI detection tool.