News for hackers. Stuff that matters.
Re:Apparently I am a robot by robocat on Saturday December 10, 2022 @10:59PM (#33939925)
I did a quick detect on some your older posts: found this one from a year ago https://news.ycombinator.com/item?id=27568715 with 65 tokens and 99.14% fake. A quick googling shows sentences to be unique. GPT2 released on February 2019, so it would be nice to find older examples than that.

Of course, does the detector have problems when text from its training corpus is used? No idea.

Maybe your brain is just closer to an ideal GPT model than some others of us?

I assume the more clichés and boiler plate you write, that the GPT-like detection of fakes increases. However although I have played with the idea a little, I haven’t yet managed to get detected as very fake. Must try harder.

Re:Apparently I am a robot by ggm on Sunday December 11, 2022 @01:10AM (#33940582)
I think I've been subtly insulted again... fail the test, more closely aligned to the statistical model of an ideal GPT and using cliché.

I plead guilty to all of them. I clearly took one for the team, let the side down, disappointed at the finish, peaked early and missed by a country mile.

Try harder. Grow a backbone. (Hu)man up!

Re:Apparently I am a robot by robocat on Sunday December 11, 2022 @01:47AM (#33940768)
77 tokens, 88.25% fake. You are really good at this game!

And https://news.ycombinator.com/item?id=18576101 which you wrote 4 years ago (before GPT2) has: 79 tokens 99.86% Fake

Hopefully someone writes a script to run the detector over past users, because we are sure to find someone who naturally writes like GPT (after all, the training corpus came from somewhere!)

Also: no intent to insult - I would be even more amused to find myself detected as fake! I just love the topic - how much subliminal judgement to we make due to subtle word order choices? For example, how much more convincing could we be with some word or grammar changes?

After testing a heap of my own old comments using https://huggingface.co/openai-detector , I found one comment of mine https://news.ycombinator.com/item?id=17216586 with 65 tokens and 68.92% Fake. I don’t think I write much like other people. I also didn’t get any “bold” matches from https://news.ycombinator.com/item?id=33755016 (edited)

Re:Apparently I am a robot by ggm on Sunday December 11, 2022 @02:06AM (#33940875)
What was the hit rate on your own response above? The quine...
Re:Apparently I am a robot by ghoward on Sunday December 11, 2022 @10:20AM (#33943884)
Hey, what tool are you using for detection? I'd like to run it on my own comments and on my blog posts.
Re:Apparently I am a robot by rdke on Sunday December 11, 2022 @06:20AM (#33942255)
Wait what if the reply that ggm is not GPT, is made by GPT?
Re:Apparently I am a robot by ggm on Sunday December 11, 2022 @06:56AM (#33942438)
Oh no pooh.. that's not honey it's.. recursion
Re:Apparently I am a robot by djokkataja on Sunday December 11, 2022 @01:01AM (#33940530)
You can search by date ranges (though the date picker is kind of weird tbh):

https://hn.algolia.com/?dateEnd=1543795200&dateRange=custom&...

Re:Apparently I am a robot by ggm on Sunday December 11, 2022 @01:15AM (#33940602)
Can I say that the response I wrote about 7% compounding is categorically not GPT and I fail to see what about it, perhaps should I say "them" since I wrote two distinct responses could be held to be artificial writing.

I truly expected it to be one of my more florid prose pieces. That was a minimally factual statement: 7% return on investment is astonishingly well documented, but under appreciated by people addicted to stonks, hodl and lambo talk. Oh dear. More cliché.. I'm doomed.

Re:Apparently I am a robot by maxbond on Sunday December 11, 2022 @01:20AM (#33940624)
I think if we ran the GPT2 spotting model against anyone's comment history we'd find a couple comments that scored really high. I doubt it's actually related to your writing style.

Alternative hypothesis is that it's not about how you're writing but where. HN appears to have been used to train GPT3.5. I don't know if it was used to train GPT2, but it might have done. So your comments might be in the training set.

Re:Apparently I am a robot by ggm on Sunday December 11, 2022 @01:34AM (#33940686)
I already suspect my blog writings and standards work in IETF are, it wrote a pretty good CV covering letter/brief biography for me according to a relative (also a computer scientist) who tested it. He also noted it stuffed up his, claimed he'd written on work which was demonstrably untrue.

RFCs and associated mailing lists are pretty widely distributed and certainly RFCs aren't ring-fenced from GPT.

So if chatbot detectors are bad on people who are inputs to the ML can't that be added to the detector?

Re:Apparently I am a robot by maxbond on Sunday December 11, 2022 @01:37AM (#33940704)
That's pretty cool. When I tried stuff like that, it was entirely based off of the prompt I gave it. I asked it to criticize my HN posts, and it came up with a story about how I was a charlatan; I asked it to summarize my views on Python exceptions in my HN posts, and it came up with a story about how I'm a world renowned Python expert. (I'm neither, but have written nothing noteworthy, so it's unsurprising.)

It could maybe be added to the detector but I think we're going to discover "did this output come from this model?" is ultimately undecidable. My intuition is that this is somehow equivalent to the halting problem, but that's a wild guess, and I'm not an AI researcher or computer scientist (just a humble SWE). Something like, if you start generating prompts that might take you to a part of latent space where this output could have been produced, you don't know when to stop generating longer and longer prompts.