News for hackers. Stuff that matters.
Re:Show HN: Whole Git repo was made with ChatGPT by Nathanba on Sunday December 04, 2022 @12:19PM (#33855535)
I thought about the AI pollution and I don't think it will matter because we already had the exact same problem with forum spam and low information / bad people (=eternal september) type content overwhelming online discourse. I think maybe combatting AI spam will be the least of our problems because humans do plenty of AI-tier spam already. I think the advent of AI may even be positive because people will start to value real human interaction more. It will be like a treasure cove when you find a forum that is highly curated with real people and you can rely on that being the case. Or (and this is just as likely): Online platforms will go towards requiring real human IDs for participants. AI spam would only be used by companies and advertisers.

Maybe eventually there will be a public understanding that only a foolish child would read a reddit frontpage and expect human content. It will all be auto generated to trap people, like a gatcha game.

Re:Show HN: Whole Git repo was made with ChatGPT by thr0wawayf00 on Sunday December 04, 2022 @12:23PM (#33855579)
> Online platforms will go towards requiring real human IDs for participants.

I just don't see how AI won't be used to manipulate these kinds of barriers. Once AI reaches a point where it can truly equal or surpass humans in terms of operating online, how are we going to prevent it from circumventing those barriers? If AI can generate code from a chat prompt, who's to say it can't solve a captcha in the future? And once that happens (because we all know it will at some point), how are we going to be able to differentiate?

Re:Show HN: Whole Git repo was made with ChatGPT by Nathanba on Sunday December 04, 2022 @12:54PM (#33855910)
real human ids = passports, bank logins
Re:Show HN: Whole Git repo was made with ChatGPT by thr0wawayf00 on Sunday December 04, 2022 @12:59PM (#33855959)
Ok, but the systems that are responsible for creating those IDs are automated, which means that they can be learned and reverse-engineered. There are lots of passports and bank logins floating around that can be used to train AI.

Do you see the problem now?

Re:Show HN: Whole Git repo was made with ChatGPT by Nathanba on Sunday December 04, 2022 @01:05PM (#33856015)
they are not automated and require real world steps
Re:Show HN: Whole Git repo was made with ChatGPT by mike_hearn on Sunday December 04, 2022 @02:20PM (#33856748)
Passports contain digitally signed X.509 certificates in their chips. No AI can learn to forge a digital signature (we hope).
Re:Show HN: Whole Git repo was made with ChatGPT by baq on Sunday December 04, 2022 @04:43PM (#33858232)
So you buy them signed at the source.
Re:Show HN: Whole Git repo was made with ChatGPT by mike_hearn on Monday December 05, 2022 @03:40AM (#33863009)
The only passport you can buy is your own, right? The signing keys are held by national governments. I don't really understand the threat model here.
Re:Show HN: Whole Git repo was made with ChatGPT by baq on Monday December 05, 2022 @04:29AM (#33863325)
A government sells you passports without validation of your identity.
Re:Show HN: Whole Git repo was made with ChatGPT by int_19h on Monday December 05, 2022 @09:13PM (#33875000)
The other problem is that AI can be put in charge of phishing operations. Once you devise the correct prompt to get past the filters, it understands what phishing is, and will quite happily write phishing emails for any audience you care to describe. Combine that with an automatic mailer, and you could just fish for IDs (along all the other profitable stuff), and then use those IDs to spam more etc.
Re:Show HN: Whole Git repo was made with ChatGPT by madars on Sunday December 04, 2022 @03:14PM (#33857361)
There is a market for KYC'd accounts. Someone operating an AI bot farm posing as Real Humans would just buy these.