News for hackers. Stuff that matters.
Re:Enumerate all the subdomains for a domain name by yup_sto on Sunday September 08, 2024 @03:11AM (#41478741)
I also noticed you are ingesting/storing flowers-to-the-world.com certs, not sure what stage of optimization you are at but blacklisting/ignoring these certs in my ingestion pipeline helped with avoiding storing unnecessary data

I'm not sure but I believe that's used by Google internally for testing purposes.

For example if you search google, it returns 120k+ results, and these useless results are at the front.

Re:Enumerate all the subdomains for a domain name by Eikon on Sunday September 08, 2024 @03:14AM (#41478751)
> I also noticed you are ingesting/storing flowers-to-the-world.com certs, not sure what stage of optimization you are at but blacklisting/ignoring these certs in my ingestion pipeline helped with avoiding storing unnecessary data

The goal is to have something exhaustive so I'll keep them. But you are right that I probably should not put them at front. Not sure how important it is though as these results shouldn't match many queries.

Re:Enumerate all the subdomains for a domain name by yup_sto on Sunday September 08, 2024 @03:35AM (#41478812)
Exhaustive/Robust is the way for sure.

Minimizing storage was a priority for me since it's just a small side-project/automation.

I've looked for information on what the hell the `flowers-to-the-world` entries are that pop and have found nothing, curious what's going on there.

Re:Enumerate all the subdomains for a domain name by Eikon on Sunday September 08, 2024 @03:39AM (#41478825)
It's actually a google thing!

I found that back then when I wondered the same: https://medium.com/@hadfieldp/hey-ryan-c0fee84b5c39

Re:Enumerate all the subdomains for a domain name by yup_sto on Sunday September 08, 2024 @03:53AM (#41478883)
Ahhhh, that tracks, cheers mate.