News for hackers. Stuff that matters.
Re:How to crawl a quarter billion webpages in 40 hours by vlad on Friday August 10, 2012 @08:07PM (#4368911)
I notice the welcome message and action buttons on the home page are all jpeg images rather than text, which makes it harder for search engines to make a judgement about the content. (The text appears fuzzy as well.) As a developer of a crawler, is there a reason you found this to be beneficial?

There are no comments on this comment yet.