News for hackers. Stuff that matters.
Re:Bypassing Gmail's spam filters with ChatGPT by 4g on Sunday January 22, 2023 @03:20PM (#34481791)
Using these tools to mitigate spam is as likely a scenario as this, imagine that every spam mail receives a masterfully crafted response showing utter fascination and interest in SEO, or helping out a Nigerian prince. Every phone call to an unregistered number is answered by an artificial, frail, and forgetful lady that is trying her best to register gift cards.

When reporting an e-mail as spam it will not only block the address but waste the spammers time, rendering the actions unprofitable.

Re:Bypassing Gmail's spam filters with ChatGPT by kibwen on Sunday January 22, 2023 @03:36PM (#34481950)
At the same time, it's not necessarily pleasant to consider the prospect of an internet where 99.9% of traffic is generated by AI-powered spambots engaged in adversarial games with AI-powered anti-spambots.
Re:Bypassing Gmail's spam filters with ChatGPT by sharkweek on Sunday January 22, 2023 @04:30PM (#34482442)
But it does make for an interesting idea as a plot device in speculative fiction!
Re:Bypassing Gmail's spam filters with ChatGPT by yieldcrv on Sunday January 22, 2023 @06:46PM (#34483631)
Cyberpunk 2077 features this reality. Its not discussed much, but basically only local small scale networking is done (like citywide scale) because the broader internet protocol has either crumbled or is polluted by adversarial bots. So its pretty taboo to go there or simply unused.

I'm sure someone else knows the lore better. There is a lot of supporting literature, just not a key component of any stories.

Re:Bypassing Gmail's spam filters with ChatGPT by thatguy0900 on Sunday January 22, 2023 @07:43PM (#34484046)
I think the lore is that the wider internet was intentionally taken down by a virus made by a master hacker in the past. Any attempts to connect with it gets you killed by either the virus or "feral ais", but some of the mega corps pay people to explore it every once in a while looking for stuff.
Re:Bypassing Gmail's spam filters with ChatGPT by ThrowawayTestr on Sunday January 22, 2023 @04:46PM (#34482567)
Honestly the most likely source of computers becoming self-aware.
Re:Bypassing Gmail's spam filters with ChatGPT by ben_w on Sunday January 22, 2023 @04:59PM (#34482679)
And a plausible way for them — on either team — to take over completely. Both treating us not even as pets but as grass. In this analogy the good AI are gardeners, the bad AI are cow farmers.
Re:Bypassing Gmail's spam filters with ChatGPT by nwellnhof on Sunday January 22, 2023 @04:57PM (#34482666)
That's basically the plot of the novel Avogadro Corp by William Hertling.
Re:Bypassing Gmail's spam filters with ChatGPT by honkler on Sunday January 22, 2023 @05:31PM (#34482933)
Re:Bypassing Gmail's spam filters with ChatGPT by atorodius on Sunday January 22, 2023 @05:58PM (#34483218)
I thought we are already nearly there? I remember reading 90%+ of emails are spam and this was a while back
Re:Bypassing Gmail's spam filters with ChatGPT by danielheath on Sunday January 22, 2023 @06:17PM (#34483422)
90% is a lower figure for how much of HTTP traffic is bots scraping sites, too.
Re:Bypassing Gmail's spam filters with ChatGPT by cortesoft on Sunday January 22, 2023 @06:20PM (#34483449)
Why is that bad? As long as it is invisible to humans and doesn't cause bottlenecks, who cares?
Re:Bypassing Gmail's spam filters with ChatGPT by mahogany on Sunday January 22, 2023 @07:59PM (#34484151)
For one, it's a waste of energy.
Re:Bypassing Gmail's spam filters with ChatGPT by resonious on Sunday January 22, 2023 @11:07PM (#34485361)
Banks also waste energy deterring people from robbing them. Internet or not, we'll have to stomach a good amount of bad stuff in order to get to the good stuff.
Re:Bypassing Gmail's spam filters with ChatGPT by shagie on Sunday January 22, 2023 @06:38PM (#34483575)
If you haven't read Accelerando, I'll suggest it - https://www.antipope.org/charlie/blog-static/fiction/acceler...
Re:Bypassing Gmail's spam filters with ChatGPT by jvm___ on Sunday January 22, 2023 @06:57PM (#34483727)
https://maggieappleton.com/ai-dark-forest

The open internet will be a dark forest, beautiful but mostly populated by metal-brains, meatb-brains will retreat to their human only spaces, local Facebook or Instagram where you know everyone in person or WhatsApp chat groups.

Re:Bypassing Gmail's spam filters with ChatGPT by shagie on Sunday January 22, 2023 @07:01PM (#34483763)
Interesting - going to have to read this more in depth.

I also note that I missed it when it went past the front page at the start of the month. For any others who also missed it - https://news.ycombinator.com/item?id=34243709

Re:Bypassing Gmail's spam filters with ChatGPT by Oxidation on Sunday January 22, 2023 @07:57PM (#34484139)
Also the Reticulum of Anathem which was mostly full of spam-generators that were run by the spam-filter vendors to make their products necessary.
Re:Bypassing Gmail's spam filters with ChatGPT by shagie on Sunday January 22, 2023 @08:53PM (#34484492)
Btw, the chants from the book are real (and part of the interludes if you get the audiobook - which I recommend since the initially boring but ultimately important parts it aren't skippable without effort).

https://soundcloud.com/ztutz/sets/iolet-music-from-the-world...

The Thousander Chant is fun if you've got the right audio setup.

https://longnow.org/store/iolet/

> In Neal Stephenson’s new novel Anathem, the Decanarian Erasmus’ daily chore is to ring the Clock bells in his “Math” in a special sequence each day as he chants out the sequence. Those sequences and chants are all based on mathematical formulae that composer and coder David Stutz has put together into an album called Iolet.

Re:Bypassing Gmail's spam filters with ChatGPT by ogennadi on Monday January 23, 2023 @08:46AM (#34488641)
I like the thousander chant but I only have regular laptop speakers. What do you recommend to really "get" the song? What would I hear beyond those super low basses?
Re:Bypassing Gmail's spam filters with ChatGPT by shagie on Monday January 23, 2023 @12:39PM (#34492133)
A good pair of headphones would be my next choice.

It's not much "under" it - but rather the fill your senses with what it would be like to be in the Mynster as each nave did their chats in the great octagonal hall. And while its a passage about the Hundreders...

> We sauntered across the meadow to the Mynster. Even so, we got there in plenty of time, and ended up in the front row, closest to the screen. Voco continued ringing for some minutes after we arrived. Then the eight ringers filed down from their balcony and found places farther back. A choir of Hundreders came out into the chancel and began a monophonic chant.

Or the description of a Thousander chat

> ... As I walked toward it my perceptions cleared suddenly and I shook my head in amazement at my own silliness in having imagined it was an amphibian or a truck. It was plainly a human voice. Singing. Or rather droning, for he had been stuck on the same note the whole time I’d been awake.

> The note changed slightly. Okay, so it wasn’t a drone. It was a chant. A very, very slow one.

> I could have stood there watching and listening for hours. I got the idea—which might have been just my imagination—that {spoilers} was singing a cosmographical chant: a requiem for the stars that were being swallowed up in the dawn. Certainly it was music of cosmographical slowness. Some of the notes went on for longer than I could hold my breath. He must have some trick of breathing and singing at the same time.

Just let the sound fill everything.

Re:Bypassing Gmail's spam filters with ChatGPT by Freeboots on Monday January 23, 2023 @02:18AM (#34486337)
Also in Reamde and later Fall. I forget exactly, but i think in Reamde they flood the internet with shit, and then some years later in Fall everyone has curated echo chambers of content, such that people signed up to different streams are basically living in different realities. Which i guess is just the logical conclusion of what we have now.
Re:Bypassing Gmail's spam filters with ChatGPT by yieldcrv on Sunday January 22, 2023 @06:47PM (#34483642)
Cyberpunk 2077 features a world after this has happened. Not because it happened, its just after. If there is a reference to an older internet it features its disuse due to this.
Re:Bypassing Gmail's spam filters with ChatGPT by nbardy on Sunday January 22, 2023 @08:06PM (#34484192)
I think the opportunity cost of better employee will make it hard for that to scale.

If you’re that good at scaling systems like that someone with legit traffic would be able to pay more than the spam companies.

Re:Bypassing Gmail's spam filters with ChatGPT by Tsiklon on Sunday January 22, 2023 @08:26PM (#34484327)
Part of this is what I imagine is behind the “Blackwall” in the Cyberpunk universe.
Re:Bypassing Gmail's spam filters with ChatGPT by epicureanideal on Sunday January 22, 2023 @11:39PM (#34485537)
There are still solutions in that case. Email addresses only allocated to verified humans, which only accept email from the same addresses or specifically allowed outside email addresses.
Re:Bypassing Gmail's spam filters with ChatGPT by sangnoir on Monday January 23, 2023 @12:07AM (#34485718)
Every day we get closer to the Slug from Accelerando (by @cstross): a self-owned sentient corporation/419 scam
Re:Bypassing Gmail's spam filters with ChatGPT by 5e92cb50239222b on Sunday January 22, 2023 @03:37PM (#34481960)
If as a (hypothetical) Nigerian prince spammer I get a "masterfully crafted response" from a mark, it would be obvious right away that I am talking to a bot. The kind of people who respond to such bait would hardly be able to write anything like that.
Re:Bypassing Gmail's spam filters with ChatGPT by Kamq on Sunday January 22, 2023 @03:43PM (#34482018)
A "masterfully crafted" response to a nigerian prince spammer would probably sound a lot like a person who can barely write, possibly with what sounds like the beginning of dementia setting in.
Re:Bypassing Gmail's spam filters with ChatGPT by jahewson on Sunday January 22, 2023 @03:39PM (#34481978)
Fun idea but impersonating someone else, especially your customer, sounds like a way to land in hot water. Also LLMs are not exactly cheap.
Re:Bypassing Gmail's spam filters with ChatGPT by Waterluvian on Sunday January 22, 2023 @03:36PM (#34481942)
Oh my god a future where you are never ever quite sure if your online circle of friends are human or not.
Re:Bypassing Gmail's spam filters with ChatGPT by jimkleiber on Sunday January 22, 2023 @04:24PM (#34482397)
I wonder if that inspires new platforms or types of tech that verify someone was typing it in vs pasting. But then do bots get better at typing it into the input boxes? Ugh.
Re:Bypassing Gmail's spam filters with ChatGPT by InCityDreams on Sunday January 22, 2023 @04:47PM (#34482572)
And you're confident right now?
Re:Bypassing Gmail's spam filters with ChatGPT by ben_w on Sunday January 22, 2023 @05:04PM (#34482716)
My online friends circle includes three dragons, two coyotes, a raven, a squirrel, and a wasp.

All totally real. But then, I am a furry, I've met many of them IRL also.

Re:Bypassing Gmail's spam filters with ChatGPT by Waterluvian on Sunday January 22, 2023 @05:09PM (#34482755)
I’d be okay with this option too. As long as people are who they claim to be and it doesn’t turn out that I’m in some horrible non-VR Matrix.
Re:Bypassing Gmail's spam filters with ChatGPT by hammyhavoc on Tuesday January 24, 2023 @09:44PM (#34513721)
yes this is dog
Re:Bypassing Gmail's spam filters with ChatGPT by Waterluvian on Sunday January 22, 2023 @04:59PM (#34482680)
I… but… oh no.
Re:Bypassing Gmail's spam filters with ChatGPT by wolverine876 on Sunday January 22, 2023 @03:32PM (#34481909)
So the two AIs will be talking to each other, trying to suss out if the other is fake (a sort of Turing test), trying to con the other to keep talking or to really buy in?
Re:Bypassing Gmail's spam filters with ChatGPT by abraae on Sunday January 22, 2023 @05:17PM (#34482819)
Sounds absurd all right. But what's to prevent this from being the future of the internet?
Re:Bypassing Gmail's spam filters with ChatGPT by codetrotter on Sunday January 22, 2023 @07:14PM (#34483847)
Reminds me of Adventure Time Season 4, episode 10: Goliad

https://adventuretime.fandom.com/wiki/Goliad_(episode)

(Spoilers follow)

> Princess Bubblegum is concerned over her mortality, and reveals her designated successor to Finn and Jake. However, things get out of control when the heir turns against Princess Bubblegum.

> […] The heir is Goliad, a pink Sphinx with a mound on her forehead […]

> […] Goliad reveals that her mound concealed a third eye, and proceeds to psychically control Finn and the obstacles in the course for a perfect completion. She explains that with her in control, everything would be perfect. […]

> […]

> […] Finn and Jake confront Goliad but are beaten by her psychic powers. Goliad tries to read Finn's mind, and Finn narrowly avoids revealing the plan by interrupting his memories with nonsense. The new creature; another sphinx with an eagle's head, white feathers, and golden hair; rescues Finn and battles Goliad. Goliad tries to convince her brother, named Stormo, that they should work together, but Stormo refuses by screeching. They engage in a psychic showdown, but with their powers matched the two creatures are eternally locked in a mental stalemate.

Re:Bypassing Gmail's spam filters with ChatGPT by dilawar on Sunday January 22, 2023 @09:56PM (#34484921)
Never thought I'd see Adventure Time reference on HN .
Re:Bypassing Gmail's spam filters with ChatGPT by gernb on Sunday January 22, 2023 @10:09PM (#34485022)
How about 2 AI developing a language to be able to speak to each other

https://www.imdb.com/title/tt0064177/

Re:Bypassing Gmail's spam filters with ChatGPT by mimimi31 on Sunday January 22, 2023 @03:42PM (#34482014)
>imagine that every spam mail receives a masterfully crafted response showing utter fascination and interest in SEO

That would necessitate reliably detecting the emails as spam in the first place though. False positives in particular could be devastating. Imagine a chat bot coming up or going along with business proposals in your name for example.

Re:Bypassing Gmail's spam filters with ChatGPT by crummy on Sunday January 22, 2023 @04:11PM (#34482279)
You could do it with humans - every time you click "mark as spam" it doesn't just trash the email, it begins a long and drawn-out chatGPT conversation with the spammer, stringing them along.
Re:Bypassing Gmail's spam filters with ChatGPT by jawr on Sunday January 22, 2023 @05:01PM (#34482697)
I’m pretty sure most spam senders black hole any response, the money is in the target clicking a link and no where else.
Re:Bypassing Gmail's spam filters with ChatGPT by crummy on Sunday January 22, 2023 @05:28PM (#34482911)
Don't most of the "nigerian-prince" type scams involve some kind of back-and-forth?
Re:Bypassing Gmail's spam filters with ChatGPT by themitigating on Sunday January 22, 2023 @06:18PM (#34483425)
Using a link to a website to start the process
Re:Bypassing Gmail's spam filters with ChatGPT by BenjiWiebe on Sunday January 22, 2023 @06:42PM (#34483599)
I get a number of spam emails with no links. Just plain text, wanting a back and forth.
Re:Bypassing Gmail's spam filters with ChatGPT by jawr on Sunday January 22, 2023 @09:15PM (#34484646)
I suspect that’s more an attempt to warm up a domain/ip or something. Manually replying to emails wouldn’t scale
Re:Bypassing Gmail's spam filters with ChatGPT by crummy on Sunday January 22, 2023 @06:54PM (#34483697)
Hmm. I confess I don't often go into my spam folder but was just going from what I recall of the back-and-forths on https://www.419eater.com/html/letters.htm
Re:Bypassing Gmail's spam filters with ChatGPT by jabroni_salad on Sunday January 22, 2023 @10:28PM (#34485138)
Look up 'pig butchering' when you get a chance. It is an elaborate process of convincing your mark to fall in love with your persona and asking them to send it money. It takes months to years to execute but marks end up losing their properties, retirement accounts, life savings, everything to it.
Re:Bypassing Gmail's spam filters with ChatGPT by walrus01 on Sunday January 22, 2023 @03:48PM (#34482064)
Sure, turn loose these tools to answer the actual spammers/UCE. But:

Speaking as an ISP, if somebody turns loose what is clearly an AUTOMATED tool shitting up the contents of my [email protected] inbox with reports from some software script, I can guarantee you it goes to /dev/null

At some point we will just block their MX at the SMTP transfer point and call it a day.

98% of that already is abusive DMCA rights holders who are ignoring our federally designated DMCA-agent address for copyright violation complaints. With their automated 3rd party things complaining about people torrenting Yellowstone or whatever.

Actual reports that are clearly written by a human saying "hey it looks like this /32 of an IP address is compromised as some sort of botnet" will get a thousand times more attention. Or the very rare cases where we have a network-engineering emergency escalation and somebody calls me on the phone.

Anything generated by chatGPT or similar will be clearly obvious enough that it matches a similar pattern and comes from an automated script.

Re:Bypassing Gmail's spam filters with ChatGPT by awb on Sunday January 22, 2023 @03:58PM (#34482147)
James Vitech did this, but manually and with humorous results:

https://youtu.be/4o5hSxvN_-s

https://youtu.be/IUjpoauJcKo

Re:Bypassing Gmail's spam filters with ChatGPT by miketery on Sunday January 22, 2023 @04:07PM (#34482238)
I think for next few years that will be cost prohibitive for 95% of Americans.
Re:Bypassing Gmail's spam filters with ChatGPT by rglullis on Sunday January 22, 2023 @04:40PM (#34482519)
Already a reality for phone spammers/scammers: https://jollyrogertelephone.com/
Re:Bypassing Gmail's spam filters with ChatGPT by just_boost_it on Sunday January 22, 2023 @05:17PM (#34482822)
There's lots of legitimate email traffic that would find itself stuck in here. I could see business questions being answered and those answers actioned on. Or legitimate sales prospecting resulting in actual orders being placed. If you choose to let a tool do your communication for you by impersonating you to the extent that another person would reasonably expect that they're talking to you, then I'm not sure you can just say "lol, that just was my spam bot" as a way of getting out of it.
Re:Bypassing Gmail's spam filters with ChatGPT by themitigating on Sunday January 22, 2023 @06:17PM (#34483413)
It wastes my time and spammers will create new addresses automatically
Re:Bypassing Gmail's spam filters with ChatGPT by EGreg on Sunday January 22, 2023 @06:58PM (#34483734)
Sure, but most spam will go the other way. When you're in a forum and you express an opinion that doesn't fit what the bot swarm is designed to police, they will gang up on you and argue against you from various angles, and you'll think your opinion is just super unpopular. If you are a famous person they'll do reputational attacks, after amassing karma points and followers across the swarm. Then they'll move on to combating the remaining human-powered outlets like nytimes.com, becoming the next Vox or Vice, but totally AI-powered. Their bots will spread their articles over the other ones. And finally, having driven humans underground in the dark forest of social media, they'll basically dominate the Internet.

The real sea change will come, though, when bot swarms control capital. For example, amassed for doing spam tasks. That capital can be deployed in a variety of ways, but the point is that corporations and networks will prefer bots because they generate more social capital, in coordinated ways, and also amass more financial capital than humans.

If you think this is far fetched, IT ALREADY HAPPENED on wall street and hedge funds. Bots have replaced people in trading and control the capital. Humans who trade among the bots get fleeced and don't even know it.

Re:Bypassing Gmail's spam filters with ChatGPT by astrange on Sunday January 22, 2023 @09:52PM (#34484893)
Letting bots make all the trading decisions is actually a good way to die due to adverse selection.

https://fortune.com/2022/06/02/zillow-6-billion-home-flippin...

> Humans who trade among the bots get fleeced and don't even know it.

Anyone who trades gets fleeced unless they know what price impact is. Don't trade, invest.

Re:Bypassing Gmail's spam filters with ChatGPT by ilyt on Monday January 23, 2023 @01:34AM (#34486145)
> Using these tools to mitigate spam is as likely a scenario as this, imagine that every spam mail receives a masterfully crafted response showing utter fascination and interest in SEO, or helping out a Nigerian prince. Every phone call to an unregistered number is answered by an artificial, frail, and forgetful lady that is trying her best to register gift cards.

Right. And who the fuck would pay for GPU time for that ?

Re:Bypassing Gmail's spam filters with ChatGPT by arcticbull on Monday January 23, 2023 @02:50AM (#34486474)
Apparently phone scammers hit Americans for $40B in 2022. At this point the economic incentives are significant enough that a federal budget line item may be in order.

[1] https://www.cnbc.com/2022/11/05/how-phone-scammers-tricked-a...

Re:Bypassing Gmail's spam filters with ChatGPT by dist1ll on Monday January 23, 2023 @03:25AM (#34486658)
The $40bn estimate was given by a company whose main product is spam prevention and call blocking.

I'd take that number with a huge grain of salt.

Re:Bypassing Gmail's spam filters with ChatGPT by ilyt on Monday January 23, 2023 @05:17AM (#34487191)
The comment was about using it to answer scammers, not to do the scams.

Obviously for scammers it would be huge benefit as they are directly profiting off it.

Re:Bypassing Gmail's spam filters with ChatGPT by arcticbull on Monday January 23, 2023 @02:45AM (#34486454)
> Every phone call to an unregistered number is answered by an artificial, frail, and forgetful lady that is trying her best to register gift cards.

Kitboga has actually been playing with this. [1] Apparently his bot was successful enough to get some bank accounts from scammers that he reported.

[1] https://www.youtube.com/watch?v=maP2DwgdBts

Re:Bypassing Gmail's spam filters with ChatGPT by sipos on Monday January 23, 2023 @02:48AM (#34486464)
A lot of spam is just a link to a page for someone to download malware or enter card details. It is already relatively easy to get these taken down if you care enough to, but a waste of time as the senders have moved on by then. The idea that spammers cannot make something that people tricked by their scam will use, but that insulates them from time wasters, is ridiculous.