News for hackers. Stuff that matters.
Re:Show HN: Letmecheckyour.site – AI tool to audit your cont... by Oras on Monday December 02, 2024 @07:18AM (#42295447)
Tried my site, looks like you're just scraping as is, and any captcha will affect the process.

I use CloudFlare, and I got:

> The page title is "Just a moment...", which is not descriptive and doesn't reflect page content.

Re:Show HN: Letmecheckyour.site – AI tool to audit your cont... by nirvanist on Monday December 02, 2024 @11:12AM (#42297566)
I'm not sure how I can bypass the Cloudflare CAPTCHA, but it's an interesting use case. I'll try to fix it and keep you updated. Thank you again for giving it a try!
Re:Show HN: Letmecheckyour.site – AI tool to audit your cont... by nirvanist on Monday December 02, 2024 @12:00PM (#42298033)
hey , can you give it a try again , i did some update.
Re:Show HN: Letmecheckyour.site – AI tool to audit your cont... by Oras on Monday December 02, 2024 @02:09PM (#42299312)
Same

> The page displays a Cloudflare challenge error, indicating a potential security or server issue that could impact SEO.

> Semantic Analysis The page currently shows a Cloudflare error and lacks essential SEO elements like a descriptive title, meta description, and proper header tags. The content is largely unavailable due to the error. Fixing the Cloudflare issue is paramount, followed by implementing appropriate title, meta description, and header tags for optimal search engine visibility.

Re:Show HN: Letmecheckyour.site – AI tool to audit your cont... by nirvanist on Monday December 02, 2024 @02:17PM (#42299386)
hmmm , actually this is can be also challenging for search engine bots for sure I m gonna dive more on this issues, thank you again
Re:Show HN: Letmecheckyour.site – AI tool to audit your cont... by Oras on Monday December 02, 2024 @02:33PM (#42299518)
if it helps, I checked my website with https://www.seobility.net/en/seocheck/ and looks fine.

I also checked my CloudFlare dashboard, and I can see crawls from Google and Bing.

Re:Show HN: Letmecheckyour.site – AI tool to audit your cont... by nirvanist on Monday December 02, 2024 @02:43PM (#42299622)
really helpful are you enabling "Block AI Bots" under scurity/bots on cloudflare
Re:Show HN: Letmecheckyour.site – AI tool to audit your cont... by Oras on Monday December 02, 2024 @02:54PM (#42299709)
no

Bot Fight Mode => Enabled. Block AI Bots => Disabled.

Re:Show HN: Letmecheckyour.site – AI tool to audit your cont... by nirvanist on Tuesday December 03, 2024 @05:31PM (#42312325)
So yeah, it needs to use a headful browser, and I’m not able to do that for now. It’s too much work for a POC, but really good case at least I learned something :) thank you again