Re:How to crawl a quarter billion webpages in 40 hours
by joshu on Friday August 10, 2012 @05:07PM
(#4368254)
(Completely aside: Your front page's colors look strange on my Mac. https://skitch.com/joshua/ecykp/80legs-custom-web-crawlers-p... -- see the blue border?)
[ Parent
| on HN ]
Re:How to crawl a quarter billion webpages in 40 hours
by ecaron on Friday August 10, 2012 @06:30PM
(#4368622)
Not just your Mac - my Firefox & Chrome on Linux. Seems the color palettes in http://80legs.com/_images/bg-home.jpg vs http://80legs.com/_images/the-most-powerful-web-crawler-ever... don't match up. Looks great on all browsers on Windows, so I'm guessing the jpgs have a color profile attached.
Re:How to crawl a quarter billion webpages in 40 hours
by showerst on Friday August 10, 2012 @06:17PM
(#4368575)
Looks like http://80legs.com/_images/the-most-powerful-web-crawler-ever... uses slightly different gradient stops than http://80legs.com/_images/bg-home.jpg