Re:Ask HN: Do you post your email address publicly?
by sebazzz on Sunday October 27, 2019 @04:34AM
(#21368500)
Wouldn't any decent HTML library, probably already used by the crawler, convert that back to plain text?
Re:Ask HN: Do you post your email address publicly?
by onion2k on Sunday October 27, 2019 @04:45AM
(#21368540)
If you're crawling the web looking for email addresses you're probably not bothering to parse the HTML. You don't need to: you can just grab the email from the raw response from the web server, along with any new links to follow.
mailto: -> mailto:
[email protected] -> abc@gmail.com
Then instead of:
<a href="mailto:[email protected]">[email protected]</a>
Use this:
<a href="mailto:abc@gmail.com"> abc@gmail.com</a>
Or this ("mailto:" also encoded):
<a href="mailto:abc@gmail.com"> abc@gmail.com</a>
source: http://www.wbwip.com/wbw/emailencoder.html