News for hackers. Stuff that matters.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by axlee on Sunday November 05, 2023 @06:47AM (#38150305)
No large-scale email scraper has the budget necessary to run the content it scrapes through a LLM. So as far as real-world goes, nothing changes: the .2 cents it would cost to run ChatGPT on a page to extract potentially obfuscated emails would cost magnitudes more than it could ever bring in revenues.

Regarding the examples provided, there is nothing there that a simple regex couldn't achieve, so I don't really see the benefit of introducing a LLM into the flow, besides making it slower and more costly. john [at] company [dot] com was never a safe obfuscation in the first place, and ~99% of text obfuscations are known (because they have to be read by a human ultimately, and conventions are a thing).

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by Tostino on Sunday November 05, 2023 @07:06AM (#38150427)
You do realize how possible it is to fine tune a task like this (along with a hundred others in a similar vein) on a tiny model you can scale on your own hardware?

I've run hundreds of millions (150m so far in a couple of weeks of non-continuous running as I tweaked things) of tokens through my 2x 3090 with a 13b llama2 model I fine tuned on tasks like: summary, knowledge graph generation, writing using the knowledge graph, grammar, spelling, and transcription correction, etc.

This type of stuff is going to be done at scale with a modest budget if you have the skills to tune more efficient and faster models to your use cases.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by jlund-molfese on Sunday November 05, 2023 @07:13AM (#38150464)
I'm also looking forward to what Apple Mail and other local clients are able to do. My laptop's CPU is idle most of the time, why not use that extra CPU time to do something cool like filter spam better?
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by diarrhea on Sunday November 05, 2023 @07:35AM (#38150601)
Microsoft already does that, and its Antimalware agent is the bane of my existence. It will see idle machines spin up their fans to full and drain batteries within a short few hours. No thank you!
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by imacomputertoo on Sunday November 05, 2023 @09:42AM (#38151530)
That sounds like something that's easily fixable with battery saving options. Basically, when in battery, don't do that. That would be a good default.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by heavyset_go on Sunday November 05, 2023 @07:20AM (#38150497)
Because that costs energy, the fact that your CPU is idle most of the time is why you can get hours of battery life.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by Tostino on Sunday November 05, 2023 @07:28AM (#38150554)
When plugged into the grid, it makes sense to spend a few cents of energy a day to filter out unwanted solicitations, harassment that you may not want to see, scam emails or texts, etc.

If I didn't have to worry about my grandparents getting scammed because they were having 99.99% of it effectively filtered or warned about at one layer or another before it actually became a problem...can you imagine how much you could lower that type of fraud/abuse?

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by MillionOClock on Sunday November 05, 2023 @07:42AM (#38150658)
> When plugged into the grid

Exactly! Apple for instance already does this with some ML tasks that only run when your device is plugged in, I think it's a great compromise.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by elygre on Sunday November 05, 2023 @08:03AM (#38150785)
The grid, of course, is less sure about this compromise.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by Tostino on Sunday November 05, 2023 @08:16AM (#38150862)
The grid can be negotiated with if we put in the infrastructure.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by kika on Sunday November 05, 2023 @08:49AM (#38151078)
the power cord has to have a data link (USB? or just networking over power line itself) through which the power outlet can tell the computer how much does the energy cost at any given time. this is a very welcome but very expensive addition to the infrastructure.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by ceejayoz on Sunday November 05, 2023 @09:20AM (#38151327)
Why would you put it in the cord? The phone/computer can handle this fine, and already has all the bits.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by kika on Sunday November 05, 2023 @10:18AM (#38151828)
my wall outlet supplies power from 3 different sources: grid, solar on the roof and/or powerwall, depending on the weather, grid status (which sucks where I live) and time of day. computer only knows time of day off the bat, everything else it has to learn in a complex way. if I have a "cost" or, better, "status" information integrated into the power itself, smart appliances (like computer) can make decisions what they can or can not run. right now I can start training my models on my 4090 at night, we have an outage, and 4090 will happily drain the powerwall, so I'll not have an A/C in the morning. models can wait, they're stupid anyway, or at least I like the A/C better.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by dylan604 on Sunday November 05, 2023 @10:21AM (#38151850)
That would cost money and lower the profits of the people that own/control the grid. I sometimes wonder how much money these robber barons spend on lobbying and other PR campaigns to convince that climate change isn't a problem and that the grid is just fine. It's one of those unanswerable questions I'm sure, but how much progress could be made be redirect that amount of money to actually improving the grid itself?
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by Tostino on Sunday November 05, 2023 @09:21PM (#38158054)
That was actually part of how I intended my "negotiated" to be taken. Part of it is a monetary negotiation where we invest more in base load and peak load, but some of it needs to be in the ability for the grid to request to shed load and the devices react accordingly.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by ceejayoz on Sunday November 05, 2023 @09:19AM (#38151320)
Settings > Battery > Health and Charging already has a “selectively charge when green energy is available” setting.

Some thermostats prioritize low-usage times, too.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by oceanplexian on Sunday November 05, 2023 @11:56AM (#38152905)
When I cook a roast in the oven it uses a couple of KWh. That should cover charging a Macbook for like, a month or two. I think we will be ok.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by vasco on Sunday November 05, 2023 @03:10PM (#38155133)
My guess is you wouldn't lower it by much because there's more incentives for attackers than for defenders to invest in these approaches, so it's likely that by the time grandmas are running LLM-based anti-fraud tooling the attackers will already be running LLM-based attacks as well.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by sanderjd on Sunday November 05, 2023 @08:12AM (#38150843)
How does one efficiently learn how to do such things, and what kinds of problems such approaches are fruitful for?

I find there to be a giant gap in learning about this stuff between material that boils down to "use magic words and system prompts to improve results from one of the big models" and "how do LLMs work from first principles".

I still haven't found a great resource that covers this middle ground, which seems to me to be where a lot of the power of these approaches is going to reside.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by Swizec on Sunday November 05, 2023 @09:13AM (#38151274)
> I still haven't found a great resource that covers this middle ground, which seems to me to be where a lot of the power of these approaches is going to reside.

Read papers, build institution, experiment.

That last part may be the most important.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by sanderjd on Monday November 06, 2023 @11:52AM (#38165048)
I think this is the disconnect: It doesn't strike me that what I'm talking about has anything to do with "papers". So from your comment, I'm once again left wondering what you mean.

My sense is that I have a much better grasp of the foundational material here, having read in depth books and papers about that, but still can't quite wrap my head around the question of how people are actually "operationalizing" this into useful software.

But to your point about experimentation, it might just be the kind of thing where there is no path to enlightenment besides working on a project and running into and overcoming all the hurdles along the way.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by somenameforme on Sunday November 05, 2023 @09:23AM (#38151356)
Basic neural net principles apply directly on over to LLMs. The middle ground would be in something like taking an number-image-to-text parser and seeing how it works. If you just search for neural net on Github you'll get a million hits, and most of all major projects will have some sort of an interactive image parser demo because it's surprisingly simple, sexy, shows a lot of different concepts, and is just awesome for learning from.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by kcorbitt on Sunday November 05, 2023 @10:06AM (#38151733)
If you're looking for a practical guide to getting started with fine tuning, I wrote one a couple of months ago that got pretty popular here on HN. Might be helpful if you're interested in playing around with it! https://news.ycombinator.com/item?id=37484135
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by Tostino on Sunday November 05, 2023 @10:20AM (#38151837)
So I described my approach to how I fine tune a specific task below to another user, but I'll copy it here:

> Design your tasks to be repeatable and small steps, call the OpenAI API and log all requests/responses. > Filter out any bad responses and take a representative sample of the data you have collected from OpenAI,and train a Mistral or Llama2 model with the request/response pairs.

> Measure the quality of your model vs OpenAI for the same inputs, and then swap out the model in your workflow once happy with the results.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by capableweb on Sunday November 05, 2023 @11:02AM (#38152286)
If you do this, be careful how/if you publish your weights trained on OpenAI output as if they look into how it was generated and it becomes clear you broke the ToS, they'll most likely ban you from the platform.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by leereeves on Sunday November 05, 2023 @11:33AM (#38152635)
How would they "look into how it was generated"?
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by capableweb on Sunday November 05, 2023 @11:37AM (#38152680)
You train your model, publish it on huggingface and then write in the README:

> This is how I made this model: Design your tasks to be repeatable and small steps, call the OpenAI API and log all requests/responses. > Filter out any bad responses and take a representative sample of the data you have collected from OpenAI,and train a Mistral or Llama2 model with the request/response pairs.

Just one example.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by Tostino on Sunday November 05, 2023 @05:32PM (#38156354)
I'm not competing with OpenAI in any sense of the word.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by jiveturkey on Sunday November 05, 2023 @06:10PM (#38156708)
I haven't read the ToS, but it may not specifically require competing to be a violation.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by jachee on Sunday November 05, 2023 @01:57PM (#38154353)
The industry term for that middle ground is a “moat”, and the people who are most familiar with it are getting paid for what they know, so they’re not giving it away.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by sanderjd on Monday November 06, 2023 @11:48AM (#38164986)
I think that may be right, but if so, that seems pretty unusual to me.

I've gone through a few of these "new kinds of software becoming useful" transition periods - most notably applications moving to the web, and then native smart phone applications - and in none of those transitions was there a dearth of resources on how to spin up on doing useful things due to this "moat" concern.

Nobody was protecting their iphone app dev moat by not publishing books and training courses on Objective-C and XCode...

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by danielmarkbruce on Sunday November 05, 2023 @09:11PM (#38157987)
huggingface is your friend.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by giancarlostoro on Sunday November 05, 2023 @09:58AM (#38151660)
If OpenAI can generate those for customers they will make a killing. Export the piece out of ChatGPT you care about and run it on-prem for way less.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by Tostino on Sunday November 05, 2023 @10:12AM (#38151781)
It's entirely possible without OpenAI doing anything else. Design your tasks to be repeatable and small steps, call the OpenAI API and log all requests/responses.

Filter out any bad responses and take a representative sample of the data you have collected from OpenAI,and train a Mistral or Llama2 model with the request/response pairs.

Measure the quality of your model vs OpenAI for the same inputs, and then swap out the model in your workflow once happy with the results.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by woadwarrior01 on Sunday November 05, 2023 @10:25AM (#38151895)
It's even easier than that. There's no need to even fine tune an LLMs to do it. Here's a screenshot[1] of a 4 bit quantised version of an off the shelf open LLM (WizardLM 13B v1.2) doing it on my Mac.

[1]: https://imgur.com/a/S9jnHWJ

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by a_wild_dandan on Sunday November 05, 2023 @11:22AM (#38152516)
Yep, I use Llama2 70b for larger tasks on my MacBook and 13b for more “single use” type tasks. It’s a game changer.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by Tostino on Sunday November 05, 2023 @09:15PM (#38158013)
That may be true, and for some tasks the accuracy may be high enough. I have gotten much more consistency in my tasks by fine tuning though.

Getting a consistently good result for one shape of input may not indicate that same performance for another shape of input for example.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by manwithaplan on Monday November 06, 2023 @11:25AM (#38164670)
The system confabulated the www subdomain of the “URL provided in the text”, right?
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by crazygringo on Sunday November 05, 2023 @11:09AM (#38152351)
But not at webscale. It's fine if you want to summarize something for personal use. The size model you're talking about is still way too large if you're trying to harvest millions of e-mail addresses from billions of webpages.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by GTP on Sunday November 05, 2023 @03:28PM (#38155313)
Why finetune a LLM if you can defeat most obfuscation tecniques with a few regex?
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by ac2u on Sunday November 05, 2023 @03:40PM (#38155440)
Because there's a chance your LLM might be able to still get what you need if the obfuscation technique is changed or altered.

Anyway, nothing to say you can't use both, or have a fallback system.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by imranq on Sunday November 05, 2023 @06:20PM (#38156788)
Is it possible to know the minimum model size / data set size it takes to train a model given certain efficiency parameters (latency, etc.)?
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by smsm42 on Sunday November 05, 2023 @07:23PM (#38157287)
You don't need a "model" for this - I remember a Coursera course on ML I did some years ago, and one of the exercises was email extraction. With some very basic algorithms, nothing more than a bunch of common python libraries and couple of days of work, it's possible to extract over 90% of emails with commonly used tricks. I'm not sure the remaining number is worth making more complicated models for it - the returns are quickly diminishing, and wasting time on spamming people who are clever enough to invent their own unique email hiding technique probably doesn't have a good ROI anyway.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by adhesive_wombat on Sunday November 05, 2023 @07:37AM (#38150612)
Indeed, a large handful of regexes would probably get you from, say, 98% (the unobfuscated majority) to 99.99% or better. That 0.01% is probably not worth the effort. And even then, it's probably few enough that you could fix them by hand (and add to the regex list as you go).
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by menzoic on Sunday November 05, 2023 @07:28AM (#38150549)
This is assuming you’re using a really big LLM behind a paid service. There are plenty of smaller open source models. Not sure at what point it’s not “large” but when fine tuned they are capable of matching the largest LLM in performance on narrow tasks.

Some of these open source models can even be run on your local machine. It’d be very inexpensive to run thousands of pages through it.

https://llm-leaderboard.streamlit.app/

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by axlee on Sunday November 05, 2023 @08:49AM (#38151085)
Scraping is about hundred of millions/billions of pages, not thousands.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by PeterisP on Sunday November 05, 2023 @09:34AM (#38151461)
The "smaller" open source models with adequate capabilities are still rather large and thus compute-intensive. Running thousands of pages through it on a random CPU won't happen in minutes but rather in days, and extracting emails from only thousands of pages is not very valuable.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by indrora on Sunday November 05, 2023 @03:40PM (#38155442)
Thousands of pages is pretty good and what I’m coming to expect on the low side for cheap (single consumer GPU or NPU) throughput with the 5…8GB models now. Heck, with some of the optimizations that Llama.cpp has made, with SafeTensors and GGUF, you can reduce the actual memory usage down.

A cheap Mac mini with apple’s neural cores is good enough that it roleplays smut with a human at human speed. We’re going to see a rapid increase in throughput to price. We’ve already got small LLMs that run on mobile phones.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by mateuszbuda on Sunday November 05, 2023 @07:16AM (#38150476)
0.2 cents is how much a single request costs for well-protect website where web scrapers look for emails (e.g. LinkedIn): https://scrapingfish.com/#pricing

Paying additional 0.2 cents per request, if it can significantly improve your success rate, is not really that much and some people use LLMs for even simpler parsing tasks to save time on development efforts.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by axlee on Sunday November 05, 2023 @07:25AM (#38150523)
I don't see how that contradicts my point. With your provider, we're talking about a 100% price increase, for what can't be more than a few points of accuracy in return (and a huuuuge slowdown, because LLMs are slow). At scale, it's all about going through a lot of pages, and fast: accuracy is a bonus, and being 90% accurate is better than being 99% accurate if the throughput is divided by 10 or more.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by victorbjorklund on Sunday November 05, 2023 @12:20PM (#38153200)
No one uses a saas like that one for large scale scraping (billions of requests)
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by Epa095 on Sunday November 05, 2023 @07:07AM (#38150432)
True, but the example in the post (Ask HN: Who is Hiring) shows somewhere it CAN be usefull: when they are not just collection emails for generic spam, but where the adressed are more valuable because they can be used for some targeted add (e.g. an add for a programming-job sendt out to programmers). Those lists are more valuable.

One can also imagine using GPT as part of a pipeline. Maybe one can extract most emails using regexps or other similar measures, but also use simple (computationally) heuristics to collect paragraphs of text which are likely to contain emails (which the regexps did not manage to extract), and then use chatGPT (or cheaper LLMs) to extract only from the most valuable paragraphs. Probably usefull (for the spammers) to also be able to categorize the paragraph, so programmers get programming-spam and chefs get chef-spam.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by paulsutter on Sunday November 05, 2023 @07:47AM (#38150675)
This is a perfect task too have an LLM identify patterns and write regexes. This is not only more efficient, you can test the code. Examples of hybrid LLM use like this are the wonderful but badly named Code Interpreter or Eureka[1] where an LLM is used to write the objective function for an RL task to learn dexterous manipulation (watch the video it’s crazy)

https://blogs.nvidia.com/blog/2023/10/20/eureka-robotics-res...

(not advocating for collecting email, just responding to all the comments that LLMs aren’t appropriate because of speed/cost)

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by mkmk on Sunday November 05, 2023 @07:59AM (#38150759)
ChatGPT does quite well on the same task when you send it multiple inputs; I think you could probably do 10 of these at a time without degradation.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by dist-epoch on Sunday November 05, 2023 @09:02AM (#38151191)
> No large-scale email scraper has the budget necessary to run the content it scrapes through a LLM.

That's why it's awesome to be able to locally run open-source LLaMA! Not to mention that by running it locally OpenAI is not aware of your shenanigans.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by ghaff on Sunday November 05, 2023 @10:45AM (#38152123)
I get very very little "obvious" email SPAM these days. I get a great deal of email from conference badge scans, retail that I've done business with, and a great number of other sources that I often/mostly don't care about but I'm not sure how you would algorithmically prevent outside of some labor-intensive and error-prone whitelist.

I'm sure some people would prefer to basically block email by default but that's not most of us.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by qingcharles on Sunday November 05, 2023 @11:05AM (#38152306)
They don't need the budget. If you are doing scraping for nefarious purposes then you already have access to large numbers of stolen credit cards to sign up for multiple OpenAI accounts. Or there are plenty of files around with thousands of OpenAI cookies you can use to borrow someone else's OpenAI account.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by pixl97 on Sunday November 05, 2023 @11:14AM (#38152397)
If cost of compute is the only argument you have on this, then we're already in game over mode, LLMs won.

Cost of LLM compute will continue to fall, models will take less CPU time to run, and the hardware will become more powerful.

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by batch12 on Sunday November 05, 2023 @03:14PM (#38155174)
There are likely only so many patterns that can exist and still be usable as a shareable and human reversible email address. Maybe one could have the llm identify these edge cases and write regex/code to parse future instances to convert back to a usable format.
Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by ac2u on Sunday November 05, 2023 @03:47PM (#38155493)
Let's say the poster works at IBM and they want to provide a means for humans to contact them and frustrate scrapers so they say:

'My email address is my username@"the company no one ever got fired for buying from".com'

Write me a regex for that.

GPT on the other hand:

https://imgur.com/a/Hw0kcee

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by batch12 on Sunday November 05, 2023 @10:34PM (#38158525)
Yes, of course- my point was that the LLM could gradually write functions to parse most of the clever patterns as it comes across them. Use the LLM as a trapdoor when nothing else matches, and in the same text generation create a script to parse the same input next time.

I agree that the LLM is more versatile and retract what I wrote earlier saying that all patterns could be accounted for. I should have said most easy to figure out patterns.

https://imgur.com/a/uFV3XD9

Re:Email Obfuscation Rendered Almost Ineffective Against Cha... by dragonwriter on Sunday November 05, 2023 @09:18PM (#38158033)
> No large-scale email scraper has the budget necessary to run the content it scrapes through a LLM

Maybe not a big third-party commercial one, a smaller, purpose tuned one that the scraper runs on their own, OTOH...