Turns out half the internet has a single-point-of-failure called “Cloudflare”

Re:Turns out half the internet has a single-point-of-failure... by zenincognito on Monday July 20, 2020 @05:34PM (#23902160)

Worth noting that cloudflare does a poor job of identifying and allowing crawlers specially Google. I have a site with 1 mil URLs , nothing big and every time you turn on cloudflare it reduces the crawler to 1k visits or less per day. If you compare your logs for visits for Google and Bing with CF turned on/off there is a huge difference.

Suffice to say, that in over 5-6 projects I have added CF to, it's never worked out in my favour.

[ Parent | on HN ]

Re:Turns out half the internet has a single-point-of-failure... by ebg13 on Monday July 20, 2020 @07:08PM (#23902826)

> I have a site with 1 mil URLs , nothing big

A million URLs isn't big?

[ Parent | on HN ]

Re:Turns out half the internet has a single-point-of-failure... by shawncampbell on Monday July 20, 2020 @11:23PM (#23904074)

Do I understand correctly that you're suggesting Cloudflare reduces organic search traffic due to restricting search engine crawlers?

[ Parent | on HN ]

Re:Turns out half the internet has a single-point-of-failure... by ksec on Monday July 20, 2020 @08:29PM (#23903273)

I wonder why. May be CF should work with Google and allow those crawlers?

[ Parent | on HN ]