Re:How to crawl a quarter billion webpages in 40 hours
by vlad on Friday August 10, 2012 @08:07PM
(#4368911)
I notice the welcome message and action buttons on the home page are all jpeg images rather than text, which makes it harder for search engines to make a judgement about the content. (The text appears fuzzy as well.) As a developer of a crawler, is there a reason you found this to be beneficial?
[ Parent
| on HN ]
There are no comments on this comment yet.